-- Logs begin at Wed 2022-08-17 06:45:17 UTC, end at Wed 2022-08-17 07:45:46 UTC. -- Aug 17 07:18:34.721202 dv-cinder-853126-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 17 07:18:34.730082 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 17 07:18:34.732068 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 07:18:34 2022] *** Aug 17 07:18:34.732068 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 07:18:34.732068 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 07:18:34.732068 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: nodename: dv-cinder-853126-2-iscsi Aug 17 07:18:34.732068 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: machine: x86_64 Aug 17 07:18:34.732068 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: clock source: unix Aug 17 07:18:34.732068 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: pcre jit disabled Aug 17 07:18:34.732068 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: detected number of CPU cores: 4 Aug 17 07:18:34.732068 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: current working directory: / Aug 17 07:18:34.732068 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: detected binary path: /usr/bin/uwsgi-core Aug 17 07:18:34.732765 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: your processes number limit is 47680 Aug 17 07:18:34.732765 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: your memory page size is 4096 bytes Aug 17 07:18:34.732765 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: detected max file descriptor number: 2048 Aug 17 07:18:34.732765 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: lock engine: pthread robust mutexes Aug 17 07:18:34.732765 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: thunder lock: enabled Aug 17 07:18:34.732765 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 17 07:18:34.732765 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 07:18:34.772011 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: Python main interpreter initialized at 0x560bb52a69c0 Aug 17 07:18:34.772011 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: python threads support enabled Aug 17 07:18:34.772011 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: your server socket listen backlog is limited to 100 connections Aug 17 07:18:34.772011 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: your mercy for graceful operations on workers is 90 seconds Aug 17 07:18:34.772342 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 07:18:34.772418 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: *** Operational MODE: preforking *** Aug 17 07:18:34.772685 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: *** uWSGI is running in multiple interpreter mode *** Aug 17 07:18:34.772685 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: spawned uWSGI master process (pid: 105537) Aug 17 07:18:34.772869 dv-cinder-853126-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 17 07:18:34.777995 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: spawned uWSGI worker 1 (pid: 105538, cores: 1) Aug 17 07:18:34.777995 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: spawned uWSGI worker 2 (pid: 105539, cores: 1) Aug 17 07:18:34.777995 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 07:18:35.429021 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 07:18:35.432389 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 07:18:36.504327 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 07:18:36.504327 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: from cryptography.utils import int_from_bytes Aug 17 07:18:36.504903 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 07:18:36.504903 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: from cryptography.utils import int_from_bytes Aug 17 07:18:36.505021 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 07:18:36.505021 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: from cryptography.utils import int_from_bytes Aug 17 07:18:36.505388 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 07:18:36.505388 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: from cryptography.utils import int_from_bytes Aug 17 07:18:38.950209 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 07:18:38.950772 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 07:18:38.950961 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 07:18:38.951315 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 07:18:38.951567 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 07:18:38.951672 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 07:18:38.952008 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 07:18:38.952087 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.952259 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.952396 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 07:18:38.952580 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.952756 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 07:18:38.952893 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.953010 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 07:18:38.953219 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.953389 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.953525 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.953700 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.953840 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.954043 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.954186 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.954362 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.954510 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.954690 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.954783 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.955000 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.955094 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.955317 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.955420 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853126-2-iscsi {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.955631 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.955723 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.955956 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.956051 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.956212 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.956305 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.956526 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.956611 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.956851 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853126-2-iscsi {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.956948 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.957167 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.957259 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.957469 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.957565 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.957775 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.957983 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.958377 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.958513 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.958622 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.958739 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.958877 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.958993 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.959098 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.959335 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.959509 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.959645 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.959818 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.959954 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.960121 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.960272 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.960477 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.960584 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.960767 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.960888 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.961078 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.961215 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.961929 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.962152 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853126-2-iscsi {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.962277 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.962472 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.962587 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.962824 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.962921 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.963093 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.963207 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.963504 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.963613 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853126-2-iscsi {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.963814 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.963928 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.964121 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.964226 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.964442 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.964536 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.964765 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.964931 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.965074 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.965241 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.965402 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.965548 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.965722 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.965867 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.966072 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.966216 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.966397 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.966525 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.966700 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.966850 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.967005 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.967166 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.967312 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.967487 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.967630 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.967805 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.967935 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.968111 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.968237 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.968418 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.968512 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.968723 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.968816 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.969041 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.969143 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.969349 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.969499 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.969652 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.969760 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.969901 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.970071 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.970211 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.970295 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.970503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.970647 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.970823 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.970926 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.971129 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.971216 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.971394 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.971479 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.971643 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.971739 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.971962 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.972050 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.972282 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.972370 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.972590 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.972684 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.972894 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.973009 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.973194 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.973283 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.973498 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.973596 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.973802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.973898 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.974230 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.974443 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.974533 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.974748 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.974846 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.975064 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.975152 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.975375 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.975463 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.975681 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.975774 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.975988 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.976075 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.976308 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.976396 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.976613 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.976705 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.976955 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.977053 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.977266 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.977353 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.977568 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.977655 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.977872 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.978052 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.978215 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.978305 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.978517 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.978618 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.978847 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.978948 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.979150 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.979238 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.979398 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.979482 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.979697 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.979952 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.980048 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.980119 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.980295 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.980450 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.980597 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.980758 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.980900 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.980996 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.981202 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.981290 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.981500 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.981598 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.981802 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.981890 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.982128 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.982235 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.982436 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.982532 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.982737 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.982825 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.983040 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.983127 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.983341 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.983440 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.983642 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.983728 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.983941 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.984034 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.984240 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.984328 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.984542 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.984629 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.984844 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.984940 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.985148 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.985236 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.985448 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.985534 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.985748 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.985842 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.986070 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.986173 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.986388 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.986478 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.986692 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.986786 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.986991 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.987327 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.987542 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.987647 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.987845 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.987941 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.988146 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.988232 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.988461 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.988547 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.988764 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.988863 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.989066 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.989160 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.989372 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.989458 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.989674 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.989772 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.989995 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.990095 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.990305 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.990391 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.990608 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.990703 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.990913 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.991009 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.991210 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.991304 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.991510 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.991597 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.991812 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.991898 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.992114 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.992209 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.992420 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.992510 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.992746 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.992834 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.993045 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.993171 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.993363 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.993459 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.993670 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.993763 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.993989 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.994093 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.994287 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.994374 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.994584 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.994669 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.994900 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.994994 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.995218 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.995308 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.995527 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.995614 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.995833 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.995930 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.996139 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.996226 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.996458 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:18:38.996553 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.996790 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.996885 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.997117 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.997209 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.997427 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.997522 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.997740 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.997841 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.998094 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.998195 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.998408 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.998508 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.998720 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.998808 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.999030 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.999118 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.999342 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.999428 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.999654 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.999785 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:38.999967 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.000061 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.000280 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.000367 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.000592 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.000764 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.000908 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.000997 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.001216 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.001304 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.001529 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.001628 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.001847 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.001940 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.002185 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.002280 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.002500 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.002590 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.002811 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.002904 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.003131 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.003226 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.003462 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.003551 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.003784 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.003870 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.004093 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.004188 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.004401 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.004487 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.004710 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.004798 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.005020 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.005115 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.005343 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.005432 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.005676 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.005763 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.006007 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.006110 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.006322 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.006421 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.006634 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.006721 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.006959 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.007055 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.007267 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.007353 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.007576 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.007669 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.007882 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.007971 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.008723 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.008814 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.009037 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.009124 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.009351 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.009438 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.009661 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.009755 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.010000 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.010103 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.010308 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.010397 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.010617 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.010819 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.010923 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.011008 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.011214 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.011303 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.011517 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.011607 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.011819 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.011906 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.012125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.012240 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.012427 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.012515 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.012731 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.012831 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.013037 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.013124 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.013341 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.013428 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.013653 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.013753 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.013980 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.014071 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.014290 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.014376 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.014600 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.014705 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.014910 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.014999 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.015212 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.015301 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.015521 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.015625 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.015829 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.015924 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.016131 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.016219 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.016441 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.016582 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.016746 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.016847 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.017046 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.017133 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.017353 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.017447 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.017660 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.017777 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.017971 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.018066 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.018289 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.018379 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.018599 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.018695 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.018904 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.018999 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.019212 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.019305 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.019518 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.019605 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.019833 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.019945 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.020140 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.020240 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.020449 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.020535 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.020763 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.020871 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.021076 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.021189 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.021382 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.021478 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.021717 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.021814 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.022033 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.022125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.022346 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.022443 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.022647 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.022753 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.022960 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.023056 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.023260 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.023357 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.023561 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.023660 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.024415 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.024516 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.024725 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.024814 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.025029 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.025118 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.025330 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.025419 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.025630 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.025718 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.025930 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.026054 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.026260 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.026351 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.026563 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.026657 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.026869 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.026957 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.027169 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.027264 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.027469 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.027568 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.027766 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.027864 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.028087 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.028174 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.028403 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.028520 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.028699 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.028791 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.029001 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.029089 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.029305 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.029403 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.029650 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.029746 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.029981 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.030121 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.030290 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.030461 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.030600 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.030689 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.030908 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.031012 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.031214 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.031305 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.031521 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.031609 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.031836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.031924 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.032143 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.032232 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.032451 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.032539 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.032757 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.032843 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.033063 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.033150 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.033376 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.033474 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.033684 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.033773 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.034008 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.034099 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.034315 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.034416 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.034639 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.034740 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.034952 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.035046 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.035271 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.035358 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.035577 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.035672 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.035882 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.035968 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.036196 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.036284 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.036503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.036608 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.036811 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.036912 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.037117 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.037205 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.037422 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.037522 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.037736 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.037824 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.038069 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.038158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.038387 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.038487 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.038697 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.038785 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.039007 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.039095 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.039346 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.039442 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.039657 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.039744 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.039955 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.040049 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.040266 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.040362 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.040584 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.040679 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.040892 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.040980 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.041206 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.041294 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.041514 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.041610 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.041829 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.041918 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.042161 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.042251 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.042468 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.042556 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.042780 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.042876 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.043083 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.043185 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.043386 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.043474 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.043692 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.043788 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.044000 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.044096 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.044305 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.044394 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.044612 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.044707 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.044913 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.045001 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.045221 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.045309 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.045525 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.045621 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.045825 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.045912 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.046149 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.046240 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.046452 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.046539 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.046767 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.046861 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.047071 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.047157 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.047374 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.047462 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.047679 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.047766 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.047977 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.048063 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.048277 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.048366 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.048595 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.048690 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.048901 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.048995 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.049201 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.049290 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.049499 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.049587 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.049798 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.049885 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.050153 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.050242 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.050460 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.050567 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.050759 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.050860 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.051059 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.051155 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.051357 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.051492 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.051666 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.051762 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.051973 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.052061 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.052279 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.052368 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.052584 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.052681 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.052899 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.052985 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.053207 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.053294 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.053512 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.053608 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.053818 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.053904 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.054144 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.054233 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.054449 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.054539 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.054755 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.054844 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.055090 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.055176 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.055395 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.055483 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.055701 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.055787 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.056004 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.056098 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.056304 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.056399 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.056610 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.056698 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.056913 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.057000 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.057219 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.057477 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.057565 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.057811 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.057898 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.058152 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.058249 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.058470 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.058557 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.058789 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.059024 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.059194 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.059354 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.059448 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.059668 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.059763 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.059986 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.060082 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.060302 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.060439 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.060618 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.060707 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.060932 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.061019 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.061235 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.061332 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.061541 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.061630 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.061843 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.061941 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.062170 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.062273 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.062472 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.062569 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.062784 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.062871 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.063084 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.063180 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.063385 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.063474 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.063685 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.063771 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.063985 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.064088 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.064292 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.064379 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.064590 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.064677 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.064891 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.064978 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.065191 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.065277 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.065490 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.065584 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.065802 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.065891 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.066125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.066228 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.066427 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.066514 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.066727 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.066815 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.067050 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.067138 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.067356 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.067444 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.067657 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.067745 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.067960 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.068054 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.068262 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.068362 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.068610 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.068704 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.068910 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.068997 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.069233 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.069329 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.069537 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.069626 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.069837 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.069926 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.070162 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.070268 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.070471 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.071053 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.071305 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.071394 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.071608 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.071698 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.071915 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.072009 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.072220 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.072316 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.072527 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.072616 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.072834 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.072922 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.073135 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.073223 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.073448 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.073545 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.073748 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.073835 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.074082 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.074179 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.074389 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.074487 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.074689 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.074778 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.074988 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.075085 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.075291 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.075377 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.075597 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.075730 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.075900 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.075996 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.076201 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.076296 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.076499 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.076587 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.076809 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.076904 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.077110 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.077196 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.077412 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.077499 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.077713 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.077810 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.078038 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.078128 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.078354 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.078441 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.078656 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.078753 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.078964 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.079057 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.079270 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.079358 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.079570 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.079667 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.079870 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.079958 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.080171 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.080257 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.080470 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.080558 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.080772 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.080870 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.081076 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.081164 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.081376 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.081463 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.081685 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.081773 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.082002 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.082108 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.082307 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.082401 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.082605 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.082700 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.082907 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.083078 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.083211 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.083301 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.083515 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.083604 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.083813 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.083909 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.084112 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.084200 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.084410 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.084496 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.084707 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.084803 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.085006 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.085094 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.085304 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.085398 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.085606 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.085696 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.085903 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.086025 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.086273 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.086863 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.087076 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.087175 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.087415 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.087504 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.087717 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.087813 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.088023 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.088120 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.088329 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.088417 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.088632 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.088721 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.088965 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.089053 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.089273 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.089400 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.089607 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.089707 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.089918 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.090050 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.090245 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.090334 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.090558 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.090654 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.090867 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.090962 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.091175 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.091262 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.091476 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.091574 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.091775 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.091863 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.092087 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.092180 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.092393 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.092489 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.092699 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.092787 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.093004 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.093091 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.093310 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.093406 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.093633 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.093728 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.093933 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.094083 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.094270 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.094396 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.094577 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.094669 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.094883 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.094970 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.095193 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.095282 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.095501 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.095596 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.095806 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.095891 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.096113 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.096199 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.096419 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.096505 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.096725 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.096810 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.097032 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.097132 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.097338 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.097427 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.097645 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.097742 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.097950 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.098056 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.098282 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.098369 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.098593 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.098698 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.098899 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.098993 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.099200 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.099295 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.099508 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.099609 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.099809 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.099896 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.100115 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.100202 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.100415 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.100512 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.100719 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.100842 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.101029 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.101116 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.101333 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.101422 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.101646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.101743 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.102020 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.102125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.102350 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.102438 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.102663 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.102751 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.102974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.103069 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.103279 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.103375 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.103606 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.103707 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.103917 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.104012 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.104230 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.104367 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.104543 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.104631 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.104847 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.104944 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.105146 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.105264 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.105451 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.105573 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.105771 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.105877 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.106096 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.106212 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.106399 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.106517 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.106700 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.106804 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.107020 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.107108 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.107323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.107420 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.107641 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.107746 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.108009 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.108162 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.108312 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.108641 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.108802 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.108940 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.109081 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.109256 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.109495 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.109676 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.109831 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.110017 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.110157 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.110303 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.110444 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.110714 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.110907 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.111053 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.111198 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.111354 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.111499 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.111646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.111807 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.111956 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.112388 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.112557 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.112704 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.112857 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.113001 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.113150 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.113316 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.113475 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.113623 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.113781 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.113929 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.114132 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.114294 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.114434 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.114592 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.114741 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.114890 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.115048 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.115197 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.115342 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.115491 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.115652 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.115797 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.115953 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.116096 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.116241 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.116390 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.116545 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.116694 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.116855 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.117001 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.117155 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.117307 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.117480 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.117647 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.117791 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.117931 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.118292 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.118436 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.118572 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.118672 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.118764 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.118855 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.118980 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.119071 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.119291 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.119465 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.119609 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.119738 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.119879 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.119970 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.120180 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.120278 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.120490 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.120577 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.120789 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.120876 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.121090 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.121185 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.121397 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.121485 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.121716 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.121804 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.122043 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.122136 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.122350 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.122438 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.122667 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.122756 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.122972 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.123076 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.123278 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.123375 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.123578 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.123667 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.123878 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.123968 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.124194 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.124290 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.124499 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.124596 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.124804 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.124893 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.125107 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.125195 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.125441 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.125537 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.125745 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.125833 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.126089 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.126191 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.126416 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.126512 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.126734 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.126822 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.127042 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.127130 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.127363 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.127464 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.127666 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.127761 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.127966 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.128055 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.128272 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.128362 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.128571 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.128663 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.128871 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.128967 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.129172 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.129261 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.129476 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.129565 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.129775 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.129863 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.130100 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.130194 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.130402 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.130490 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.130711 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.130800 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.131010 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.131099 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.131311 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.131401 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.131614 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.131711 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.131912 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.132004 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.132213 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.132302 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.132514 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.132612 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.132827 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.132915 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.133664 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.133763 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.134013 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.134120 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.134300 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.134391 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.134623 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.134712 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.134939 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.135034 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.135252 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.135340 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.135562 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.135652 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.135875 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.135965 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.136188 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.136277 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.136500 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.136588 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.136811 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.136899 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.137117 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.137204 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.137428 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.137515 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.137737 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.137826 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.138072 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.138164 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.138383 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.138593 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.138695 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.138920 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.139009 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.139234 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.139324 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.139548 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.139810 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.139899 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.140139 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.140234 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.140453 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.140550 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.140760 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.140848 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.141069 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.141165 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.141379 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.141479 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.141686 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.141775 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.142017 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.142106 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.142350 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.142439 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.142674 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.142772 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.143009 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.143099 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.143325 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.143416 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.143640 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.143736 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.143960 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.144049 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.144271 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.144362 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.144599 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.144686 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.144917 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.145017 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.145218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.145305 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.145527 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.145614 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.145841 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.145941 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.146177 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.146269 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.146486 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.146581 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.146794 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.146884 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.147102 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.147197 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.147411 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.147559 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.147720 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.147879 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.148027 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.148192 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.148337 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.148508 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.148646 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.149371 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.149504 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.149687 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.149839 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.150019 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.150186 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.150332 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.150498 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.150648 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.150809 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.150976 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.151128 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.151314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.151623 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.151721 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.151935 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.152032 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.152247 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.152347 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.152561 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.152657 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.152890 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.153082 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.153208 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.153398 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.153526 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.153732 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.153858 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.154094 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.154198 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.154423 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.154512 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.154743 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.154840 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.155063 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.155154 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.155362 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.155449 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.155682 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.155779 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.155986 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.156081 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.156286 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.156373 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.156598 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.156686 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.156901 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.156989 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.157226 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.157422 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.157540 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.157764 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.157852 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.158107 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.158199 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.158434 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.158533 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.158757 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.158994 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.159083 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.159351 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.159447 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.159670 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.159767 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.159973 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.160067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.160275 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.160377 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.160589 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.160678 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.160899 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.160987 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.161202 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.161302 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.161505 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.161596 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.161812 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.161907 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.162143 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.162288 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.162446 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.162535 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.162753 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.162840 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.163052 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.163167 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.163362 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.163449 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.163664 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.163752 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.163967 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.164055 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.164266 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.164380 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.164597 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.164694 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.164899 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.164994 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.165199 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.165297 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.165501 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.165590 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.165802 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.165892 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.166133 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.166226 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.166434 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.166530 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.166738 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.166834 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.167038 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.167125 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.167340 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.167511 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.167639 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.167727 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.167942 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.168032 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.168242 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.168357 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.168545 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.168633 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.168851 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.168939 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.169153 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.169253 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.169469 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.169558 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.169774 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.169862 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.170121 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.170229 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.170429 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.170518 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.170737 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.170823 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.171079 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.171166 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.171391 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.171484 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.171713 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.171917 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.172014 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.172251 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.172386 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.172571 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.172660 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.172901 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.172998 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.173229 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.173475 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.173564 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.173812 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.173900 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.174141 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.174242 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.174467 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.174563 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.174778 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.174877 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.175089 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.175177 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.175390 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.175484 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.175695 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.175797 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.176001 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.176088 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.176309 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.176415 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.176616 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.176712 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.176923 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.177010 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.177231 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.177318 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.177535 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.177624 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.177842 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.178008 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.178174 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.178264 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.178480 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.178576 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.178786 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.178874 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.179093 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.179180 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.179409 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.179499 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.179718 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.179806 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.180054 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.180155 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.180365 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.180461 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.180675 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.180763 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.180982 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.181084 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.181287 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.181376 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.181593 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.181681 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.181898 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.182048 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.182233 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.182323 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.182547 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.182636 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.182884 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.182982 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.183154 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.183242 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.183461 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.183557 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.183776 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.183872 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.184105 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.184196 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.184419 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.184515 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.184723 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.184813 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.185072 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.185159 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.185394 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.185495 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.185703 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.185792 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.186042 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.186148 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.186352 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.186449 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.186678 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.186773 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.187002 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.187091 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.187314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.187415 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.187634 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.187730 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.187936 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.188059 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.188239 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.188337 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.188541 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.188637 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.188846 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.188934 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.189161 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.189250 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.189466 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.189554 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.189767 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.189856 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.190093 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.190197 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.190401 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.190490 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.190700 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.190789 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.191001 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.191091 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.191302 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.191396 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.191599 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.191694 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.191907 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.192006 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.192202 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.192290 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.192502 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.192599 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.192802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.192889 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.193098 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.193186 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.193398 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.193495 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.193696 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.193784 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.194016 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.194118 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.194321 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.194417 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.194622 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.194716 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.194919 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.195013 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.195218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.195318 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.195517 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.196117 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.196329 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.196416 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.196634 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.196726 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.196937 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.197027 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.197240 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.197336 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.197542 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.197631 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.197873 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.197995 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.198207 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.198305 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.198525 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.198615 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.198843 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.198932 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.199151 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.199246 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.199456 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.199542 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.199773 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.199860 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.200082 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.200182 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.200435 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.200532 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.200695 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.200784 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.201002 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.201098 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.201306 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.201401 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.201612 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.201700 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.201931 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.202103 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.202265 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.202357 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.202570 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.202712 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.202875 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.202973 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.203182 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.203285 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.203497 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.203585 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.203810 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.203900 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.204115 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.204201 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.204438 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.204528 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.204745 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.204839 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.205052 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.205141 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.205360 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.205496 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.205667 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.205757 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.206015 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.206120 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.206306 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.206409 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.206614 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.206702 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.206919 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.207013 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.207225 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.207321 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.207534 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.207630 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.207850 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.207939 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.208159 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.208293 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.208466 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.208554 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.208776 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.208863 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.209089 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.209179 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.209416 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.209512 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.209737 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.209832 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.210081 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.210184 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.210410 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.210510 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.210721 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.210821 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.211031 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.211121 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.211870 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.211967 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.212119 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 07:18:39.212242 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.212560 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.212875 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.213185 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.213491 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:18:39.213734 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 07:18:39.364442 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO dbcounter [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] Registered counter for database nova_api Aug 17 07:18:39.365849 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO dbcounter [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] Registered counter for database nova_api Aug 17 07:18:39.386415 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_db.sqlalchemy.engines [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 07:18:39.387995 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG oslo_db.sqlalchemy.engines [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 07:18:39.392995 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG dbcounter [-] [105538] Writer thread running {{(pid=105538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 07:18:39.394478 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG dbcounter [-] [105539] Writer thread running {{(pid=105539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 07:18:39.448187 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.context [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e30419f5-f844-4338-aa4e-6c29191d9231(cell1) {{(pid=105538) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 07:18:39.450147 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.context [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e30419f5-f844-4338-aa4e-6c29191d9231(cell1) {{(pid=105539) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 07:18:39.452113 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:18:39.452532 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:18:39.453940 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG oslo_concurrency.lockutils [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:18:39.454201 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:18:39.454432 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG oslo_concurrency.lockutils [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:18:39.454916 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:18:39.455359 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:18:39.455999 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG oslo_concurrency.lockutils [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:18:39.456714 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG oslo_concurrency.lockutils [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:18:39.457157 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG oslo_concurrency.lockutils [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:18:39.457316 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:18:39.459166 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG oslo_concurrency.lockutils [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:18:39.459316 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO dbcounter [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] Registered counter for database nova_cell0 Aug 17 07:18:39.461122 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO dbcounter [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] Registered counter for database nova_cell0 Aug 17 07:18:39.465053 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO dbcounter [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] Registered counter for database nova_cell1 Aug 17 07:18:39.466692 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO dbcounter [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] Registered counter for database nova_cell1 Aug 17 07:18:39.472375 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_db.sqlalchemy.engines [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 07:18:39.473698 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_db.sqlalchemy.engines [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 07:18:39.475461 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG oslo_db.sqlalchemy.engines [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 07:18:39.478611 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG oslo_db.sqlalchemy.engines [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 07:18:39.480397 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG dbcounter [-] [105538] Writer thread running {{(pid=105538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 07:18:39.482658 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG dbcounter [-] [105538] Writer thread running {{(pid=105538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 07:18:39.482768 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG dbcounter [-] [105539] Writer thread running {{(pid=105539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 07:18:39.488620 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG dbcounter [-] [105539] Writer thread running {{(pid=105539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 07:18:39.625731 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO dbcounter [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] Registered counter for database nova_cell0 Aug 17 07:18:39.626725 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO dbcounter [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] Registered counter for database nova_cell0 Aug 17 07:18:39.632499 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_db.sqlalchemy.engines [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 07:18:39.635002 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG oslo_db.sqlalchemy.engines [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 07:18:39.637706 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG dbcounter [-] [105538] Writer thread running {{(pid=105538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 07:18:39.639398 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG dbcounter [-] [105539] Writer thread running {{(pid=105539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 07:18:39.975399 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: WARNING keystonemiddleware.auth_token [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 07:18:39.976013 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: WARNING keystonemiddleware.auth_token [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 07:18:39.982677 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: WARNING keystonemiddleware.auth_token [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 07:18:39.982810 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: WARNING keystonemiddleware.auth_token [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 07:18:40.323911 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: WARNING keystonemiddleware.auth_token [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 07:18:40.324705 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: WARNING keystonemiddleware.auth_token [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 07:18:40.329789 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: WARNING keystonemiddleware.auth_token [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 07:18:40.330694 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: WARNING keystonemiddleware.auth_token [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 07:18:40.335037 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560bb52a69c0 pid: 105539 (default app) Aug 17 07:18:40.335926 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560bb52a69c0 pid: 105538 (default app) Aug 17 07:18:40.337161 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:18:40.338362 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-0038fb60-32b9-43c2-9615-a6052c15a099 None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001740 Aug 17 07:18:40.338770 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Wed Aug 17 07:18:40 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:19:57.814794 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:19:57.816107 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002076 Aug 17 07:19:57.816570 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 17 07:19:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:19:57.827925 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG dbcounter [-] [105539] Writing DB stats nova_api:SELECT=3 {{(pid=105539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:57.829030 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG dbcounter [-] [105539] Writing DB stats nova_cell0:SELECT=3 {{(pid=105539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:57.829998 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG dbcounter [-] [105539] Writing DB stats nova_cell1:SELECT=3 {{(pid=105539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:57.830890 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG dbcounter [-] [105539] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:58.687730 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-1b985502-2a6d-492e-b595-80e86017b359 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:19:58.719433 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-1b985502-2a6d-492e-b595-80e86017b359 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.896547 Aug 17 07:19:58.722006 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 2/3] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 17 07:19:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:20:01.043502 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:01.044301 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-2b75bfb5-337f-4dfd-93a2-4ae381b627a3 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 17 07:20:01.045107 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 2/4] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 17 07:20:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:20:01.522733 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-ec377e0d-9876-4693-ab87-b2abdd984012 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256"}} {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:01.543498 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:20:01.543498 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: warnings.warn(msg) Aug 17 07:20:01.571444 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-ec377e0d-9876-4693-ab87-b2abdd984012 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.520608 Aug 17 07:20:01.572268 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 3/5] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 17 07:20:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 07:20:01.586034 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG dbcounter [-] [105538] Writing DB stats nova_api:SELECT=3 {{(pid=105538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:01.587085 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG dbcounter [-] [105538] Writing DB stats nova_cell1:SELECT=3 {{(pid=105538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:01.587823 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG dbcounter [-] [105538] Writing DB stats nova_cell0:SELECT=3 {{(pid=105538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:01.588794 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG dbcounter [-] [105538] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:01.790529 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-9bb96993-7f9b-4548-b631-cf72ab11d59c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:01.794838 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:20:01.794838 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: warnings.warn(msg) Aug 17 07:20:01.855448 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-9bb96993-7f9b-4548-b631-cf72ab11d59c admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.275217 Aug 17 07:20:01.855958 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 3/6] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 17 07:20:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:20:04.178663 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-ec377e0d-9876-4693-ab87-b2abdd984012 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:04.179713 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-ec377e0d-9876-4693-ab87-b2abdd984012 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 17 07:20:04.180255 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 4/7] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 17 07:20:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:20:04.844480 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-91bcf7d2-69a2-4907-82fb-b0705cc2220c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:04.864430 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:20:04.864430 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: warnings.warn(msg) Aug 17 07:20:04.884932 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-91bcf7d2-69a2-4907-82fb-b0705cc2220c admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.696497 Aug 17 07:20:04.885488 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 4/8] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 17 07:20:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 07:20:04.898639 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-ddd2eeb3-9473-419e-87fe-9909f514c655 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:04.901583 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:20:04.901583 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: warnings.warn(msg) Aug 17 07:20:04.938789 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-ddd2eeb3-9473-419e-87fe-9909f514c655 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044815 Aug 17 07:20:04.946469 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 5/9] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 17 07:20:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (3 switches on core 0) Aug 17 07:20:07.295090 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-91bcf7d2-69a2-4907-82fb-b0705cc2220c admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:07.296024 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-91bcf7d2-69a2-4907-82fb-b0705cc2220c admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 17 07:20:07.296433 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 17 07:20:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:20:07.699132 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-dfa9b734-e480-48d8-afb3-8589bd1487b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "ram": 1024, "name": "ds1G", "swap": 0, "id": "d2", "disk": 10}} {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:07.716908 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-dfa9b734-e480-48d8-afb3-8589bd1487b7 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.413877 Aug 17 07:20:07.717450 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 6/11] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 17 07:20:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 07:20:07.730274 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-19b30a97-3e5c-43a1-83bb-2f137261e3ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:07.753924 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-19b30a97-3e5c-43a1-83bb-2f137261e3ca admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027281 Aug 17 07:20:07.754606 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 6/12] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 17 07:20:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:20:10.075404 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-dfa9b734-e480-48d8-afb3-8589bd1487b7 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:10.076408 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-dfa9b734-e480-48d8-afb3-8589bd1487b7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 17 07:20:10.076804 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 7/13] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 17 07:20:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:20:10.547172 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-ef9abd4b-7014-4961-97b4-333db8978429 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:10.568405 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-ef9abd4b-7014-4961-97b4-333db8978429 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.485641 Aug 17 07:20:10.569247 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 7/14] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 17 07:20:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 07:20:10.580894 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-95a9dd45-5ebc-4125-8974-357062c57936 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:10.605870 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-95a9dd45-5ebc-4125-8974-357062c57936 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028543 Aug 17 07:20:10.606637 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 8/15] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 17 07:20:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:20:12.949992 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-ef9abd4b-7014-4961-97b4-333db8978429 admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:12.951011 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-ef9abd4b-7014-4961-97b4-333db8978429 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 17 07:20:12.951405 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 8/16] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 17 07:20:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:20:13.393541 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-c9d4b6d7-14cb-4a56-8d41-ac94dc217b9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "os-flavor-access:is_public": true, "ram": 4096, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0}} {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:13.416275 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-c9d4b6d7-14cb-4a56-8d41-ac94dc217b9f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.458863 Aug 17 07:20:13.417535 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 9/17] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 17 07:20:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 07:20:13.429377 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-7363a299-e597-476a-991d-3412319ff9eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:13.453035 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-7363a299-e597-476a-991d-3412319ff9eb admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027817 Aug 17 07:20:13.453818 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 9/18] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 17 07:20:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:20:15.812140 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-c9d4b6d7-14cb-4a56-8d41-ac94dc217b9f admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:15.813147 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-c9d4b6d7-14cb-4a56-8d41-ac94dc217b9f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 17 07:20:15.813553 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 10/19] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 17 07:20:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:20:16.245014 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-da9bc9f6-75ea-417a-84a3-c3a4d0c79084 admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:16.271014 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-da9bc9f6-75ea-417a-84a3-c3a4d0c79084 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.450775 Aug 17 07:20:16.271590 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 10/20] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 17 07:20:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:20:18.658137 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-c9d4b6d7-14cb-4a56-8d41-ac94dc217b9f admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:18.659063 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-c9d4b6d7-14cb-4a56-8d41-ac94dc217b9f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 17 07:20:18.659461 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 11/21] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 17 07:20:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:20:19.100923 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-89215523-396c-4e97-9208-654cb6826b95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:19.120577 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-89215523-396c-4e97-9208-654cb6826b95 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.454890 Aug 17 07:20:19.121098 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 11/22] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 17 07:20:18 2022] POST /compute/v2.1/flavors => generated 402 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 07:20:19.135218 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-78574e48-29ac-44a6-a39e-0bb04f5e9569 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:19.164473 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-78574e48-29ac-44a6-a39e-0bb04f5e9569 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033990 Aug 17 07:20:19.165238 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 12/23] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 17 07:20:19 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:20:21.505991 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-89215523-396c-4e97-9208-654cb6826b95 admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:21.507028 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-89215523-396c-4e97-9208-654cb6826b95 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 17 07:20:21.507422 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 12/24] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 17 07:20:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:20:21.908186 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-dbd65a9b-bd8c-4668-a71e-2de0918e9562 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "2"}} {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:21.925832 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-dbd65a9b-bd8c-4668-a71e-2de0918e9562 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.412439 Aug 17 07:20:21.926402 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 13/25] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 17 07:20:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 07:20:21.938285 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-78bb2ec8-ab1c-4d74-9eaa-6933a68cdddd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:21.963652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-78bb2ec8-ab1c-4d74-9eaa-6933a68cdddd admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029030 Aug 17 07:20:21.964203 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 13/26] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 17 07:20:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:20:24.277223 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-dbd65a9b-bd8c-4668-a71e-2de0918e9562 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:24.278929 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-dbd65a9b-bd8c-4668-a71e-2de0918e9562 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002479 Aug 17 07:20:24.279398 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 14/27] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 17 07:20:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:20:24.679925 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-4bec0272-1df4-47f7-a287-d7bdb9bdf093 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "id": "3", "os-flavor-access:is_public": true}} {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:24.700361 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-4bec0272-1df4-47f7-a287-d7bdb9bdf093 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.414973 Aug 17 07:20:24.701179 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 14/28] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 17 07:20:24 2022] POST /compute/v2.1/flavors => generated 406 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 07:20:24.713686 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-49544add-675b-4067-8dc4-3b28a219b41c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:24.740898 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-49544add-675b-4067-8dc4-3b28a219b41c admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030685 Aug 17 07:20:24.754243 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 15/29] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 17 07:20:24 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:20:27.117733 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-4bec0272-1df4-47f7-a287-d7bdb9bdf093 admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:27.118919 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-4bec0272-1df4-47f7-a287-d7bdb9bdf093 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 17 07:20:27.119162 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 15/30] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 17 07:20:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:20:27.552982 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-1fbd635e-2968-4a5a-8ee2-c0d60bf90f82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "id": "4", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "vcpus": 4, "disk": 80, "os-flavor-access:is_public": true}} {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:27.578255 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-1fbd635e-2968-4a5a-8ee2-c0d60bf90f82 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.452612 Aug 17 07:20:27.578795 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 16/31] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 17 07:20:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 07:20:27.591499 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-d2d34d4b-8cfa-4567-9c19-a15642754349 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:27.616216 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-d2d34d4b-8cfa-4567-9c19-a15642754349 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028577 Aug 17 07:20:27.616780 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 16/32] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 17 07:20:27 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:20:29.962821 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-1fbd635e-2968-4a5a-8ee2-c0d60bf90f82 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:29.964668 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-1fbd635e-2968-4a5a-8ee2-c0d60bf90f82 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002229 Aug 17 07:20:29.965281 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 17/33] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 17 07:20:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:20:30.469018 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-e0cea807-322b-431f-a15d-9cf7f0be9106 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "vcpus": 8, "id": "5", "rxtx_factor": 1.0, "swap": 0, "ram": 16384, "disk": 160}} {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:30.490204 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-e0cea807-322b-431f-a15d-9cf7f0be9106 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.518590 Aug 17 07:20:30.490943 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 17/34] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 17 07:20:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 07:20:30.502787 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-d8c56e8e-47b3-4710-ab67-fa78a147872e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:30.508173 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG dbcounter [-] [105539] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:30.528778 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-d8c56e8e-47b3-4710-ab67-fa78a147872e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029651 Aug 17 07:20:30.529364 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 18/35] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 17 07:20:30 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:20:49.401571 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-e0cea807-322b-431f-a15d-9cf7f0be9106 admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:49.402623 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-e0cea807-322b-431f-a15d-9cf7f0be9106 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 17 07:20:49.403022 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 18/36] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 17 07:20:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:20:49.786270 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-db100744-f3fa-4419-a8c8-84cd07203355 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:49.803652 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-db100744-f3fa-4419-a8c8-84cd07203355 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.394502 Aug 17 07:20:49.804169 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 19/37] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 17 07:20:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:20:50.847922 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-e0cea807-322b-431f-a15d-9cf7f0be9106 admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:50.848998 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-e0cea807-322b-431f-a15d-9cf7f0be9106 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Aug 17 07:20:50.849394 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 19/38] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 17 07:20:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:20:51.477868 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-11494e62-418c-4b1e-b99a-2097ac688909 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:51.483393 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.wsgi [None req-11494e62-418c-4b1e-b99a-2097ac688909 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-11494e62-418c-4b1e-b99a-2097ac688909 admin admin] Request method failure captured: Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Accept: application/json Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Accept-Encoding: gzip, deflate Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Connection: keep-alive Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Content-Length: 0 Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Host: 10.222.0.45 Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Openstack-Api-Version: compute 2.90 Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Openstack-System-Scope: None Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: User-Agent: python-novaclient Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Auth-Token: gAAAAABi_JbSGQVxKjLOa8n1-GjgTI7eiG4e6QuPr_0jnoiMmF10sS8QIQOvmWo-DVez5Nv83HPRRSX1Ot0w7Iffbabhl8PGV4yqkNaINsHGMVqeHQ_ql0CTUER7_m1p0mpWP8IM5yKpYZJU2NGcUqW3G94cKU904OwyTyIZYGRASjhQwEf-i28 Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Domain-Id: None Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Domain-Name: None Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Identity-Status: Confirmed Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Is-Admin-Project: True Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Project-Domain-Id: default Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Project-Domain-Name: Default Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Project-Id: 93dca03ccb1d4c01b8cd3b051645d149 Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Project-Name: admin Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Role: member,admin,reader Aug 17 07:20:51.486659 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Roles: member,admin,reader Aug 17 07:20:51.488621 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_93dca03ccb1d4c01b8cd3b051645d149"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/93dca03ccb1d4c01b8cd3b051645d149"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/93dca03ccb1d4c01b8cd3b051645d149"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/93dca03ccb1d4c01b8cd3b051645d149"}]}] Aug 17 07:20:51.488621 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Tenant: admin Aug 17 07:20:51.488621 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Tenant-Id: 93dca03ccb1d4c01b8cd3b051645d149 Aug 17 07:20:51.488621 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Tenant-Name: admin Aug 17 07:20:51.488621 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-User: admin Aug 17 07:20:51.488621 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-User-Domain-Id: default Aug 17 07:20:51.488621 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-User-Domain-Name: Default Aug 17 07:20:51.488621 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-User-Id: 385e8184512a438fb380879d377e1eb7 Aug 17 07:20:51.488621 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-User-Name: admin Aug 17 07:20:51.488621 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: method: > Aug 17 07:20:51.488621 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: exception: Flavor 42 could not be found. Aug 17 07:20:51.488621 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: action_args: {'id': '42'} Aug 17 07:20:51.488621 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:20:51.488621 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:20:51.489646 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:20:51.490802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:20:51.490802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:20:51.490802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:20:51.490802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:20:51.490802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 07:20:51.490802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:20:51.490802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 17 07:20:51.490802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Aug 17 07:20:51.490802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:20:51.490802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Aug 17 07:20:51.490802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:20:51.490802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:20:51.490802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:20:51.490802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:20:51.490802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:20:51.490802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 17 07:20:51.490802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Aug 17 07:20:51.490802 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-11494e62-418c-4b1e-b99a-2097ac688909 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:20:51.491937 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-11494e62-418c-4b1e-b99a-2097ac688909 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.502200 Aug 17 07:20:51.491937 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 20/39] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 17 07:20:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 503 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:51.497805 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-af1e08f0-5c73-4b63-8687-080a1b48b55d admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:51.502029 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG dbcounter [-] [105538] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:51.522106 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-af1e08f0-5c73-4b63-8687-080a1b48b55d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027765 Aug 17 07:20:51.522638 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 20/40] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 17 07:20:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:20:51.532192 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-4f73a98b-16cd-48d3-8cff-9944ee24717d admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:51.555678 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-4f73a98b-16cd-48d3-8cff-9944ee24717d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027021 Aug 17 07:20:51.556193 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 21/41] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 17 07:20:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:20:51.566089 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-6760e135-c35a-465d-8b25-268a6b1450a7 admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:51.571917 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.wsgi [None req-6760e135-c35a-465d-8b25-268a6b1450a7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-6760e135-c35a-465d-8b25-268a6b1450a7 admin admin] Request method failure captured: Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Accept: application/json Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Accept-Encoding: gzip, deflate Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Connection: keep-alive Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Content-Length: 0 Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Host: 10.222.0.45 Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Openstack-Api-Version: compute 2.90 Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Openstack-System-Scope: None Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: User-Agent: python-novaclient Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Auth-Token: gAAAAABi_JbSGQVxKjLOa8n1-GjgTI7eiG4e6QuPr_0jnoiMmF10sS8QIQOvmWo-DVez5Nv83HPRRSX1Ot0w7Iffbabhl8PGV4yqkNaINsHGMVqeHQ_ql0CTUER7_m1p0mpWP8IM5yKpYZJU2NGcUqW3G94cKU904OwyTyIZYGRASjhQwEf-i28 Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Domain-Id: None Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Domain-Name: None Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Identity-Status: Confirmed Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Is-Admin-Project: True Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Project-Domain-Id: default Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Project-Domain-Name: Default Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Project-Id: 93dca03ccb1d4c01b8cd3b051645d149 Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Project-Name: admin Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Role: member,admin,reader Aug 17 07:20:51.575125 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Roles: member,admin,reader Aug 17 07:20:51.576680 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_93dca03ccb1d4c01b8cd3b051645d149"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/93dca03ccb1d4c01b8cd3b051645d149"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/93dca03ccb1d4c01b8cd3b051645d149"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/93dca03ccb1d4c01b8cd3b051645d149"}]}] Aug 17 07:20:51.576680 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Tenant: admin Aug 17 07:20:51.576680 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Tenant-Id: 93dca03ccb1d4c01b8cd3b051645d149 Aug 17 07:20:51.576680 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Tenant-Name: admin Aug 17 07:20:51.576680 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-User: admin Aug 17 07:20:51.576680 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-User-Domain-Id: default Aug 17 07:20:51.576680 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-User-Domain-Name: Default Aug 17 07:20:51.576680 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-User-Id: 385e8184512a438fb380879d377e1eb7 Aug 17 07:20:51.576680 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-User-Name: admin Aug 17 07:20:51.576680 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: method: > Aug 17 07:20:51.576680 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: exception: Flavor 42 could not be found. Aug 17 07:20:51.576680 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: action_args: {'id': '42'} Aug 17 07:20:51.576680 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:20:51.576680 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:20:51.577652 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:20:51.578974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:20:51.578974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:20:51.578974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:20:51.578974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:20:51.578974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 07:20:51.578974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:20:51.578974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 17 07:20:51.578974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Aug 17 07:20:51.578974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:20:51.578974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Aug 17 07:20:51.578974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:20:51.578974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:20:51.578974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:20:51.578974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:20:51.578974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:20:51.578974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 17 07:20:51.578974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Aug 17 07:20:51.578974 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-6760e135-c35a-465d-8b25-268a6b1450a7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:20:51.580334 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-6760e135-c35a-465d-8b25-268a6b1450a7 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014625 Aug 17 07:20:51.580334 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 21/42] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 17 07:20:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 17 07:20:52.534119 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-4f73a98b-16cd-48d3-8cff-9944ee24717d admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:52.535619 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-4f73a98b-16cd-48d3-8cff-9944ee24717d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 Aug 17 07:20:52.536039 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 22/43] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 17 07:20:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:20:53.048337 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-76a53e3d-8d6b-4abd-ab75-abf0dd9d362a admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:53.053537 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.wsgi [None req-76a53e3d-8d6b-4abd-ab75-abf0dd9d362a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-76a53e3d-8d6b-4abd-ab75-abf0dd9d362a admin admin] Request method failure captured: Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Accept: application/json Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Accept-Encoding: gzip, deflate Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Connection: keep-alive Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Content-Length: 0 Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Host: 10.222.0.45 Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Openstack-Api-Version: compute 2.90 Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Openstack-System-Scope: None Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: User-Agent: python-novaclient Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Auth-Token: gAAAAABi_JbUW40Dv62IeLAdXiLwKOfejbkp_RKetlI741k8pczybFLnQjoPs5rQbA9SCUdyZiUsN-uR0HFnzbVZPZWlsxArFl43qxwvNLvgNu8mFSVEp_C_v6TK13pQCZSqM7FOS4aTUhus3Z6HHX9j_r9z2xNfrOfhBPXV_y6zLn_CEvnFUQ8 Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Domain-Id: None Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Domain-Name: None Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Identity-Status: Confirmed Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Is-Admin-Project: True Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Project-Domain-Id: default Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Project-Domain-Name: Default Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Project-Id: 93dca03ccb1d4c01b8cd3b051645d149 Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Project-Name: admin Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Role: member,admin,reader Aug 17 07:20:53.055323 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Roles: member,admin,reader Aug 17 07:20:53.056865 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_93dca03ccb1d4c01b8cd3b051645d149"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/93dca03ccb1d4c01b8cd3b051645d149"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/93dca03ccb1d4c01b8cd3b051645d149"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/93dca03ccb1d4c01b8cd3b051645d149"}]}] Aug 17 07:20:53.056865 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Tenant: admin Aug 17 07:20:53.056865 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Tenant-Id: 93dca03ccb1d4c01b8cd3b051645d149 Aug 17 07:20:53.056865 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Tenant-Name: admin Aug 17 07:20:53.056865 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-User: admin Aug 17 07:20:53.056865 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-User-Domain-Id: default Aug 17 07:20:53.056865 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-User-Domain-Name: Default Aug 17 07:20:53.056865 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-User-Id: 385e8184512a438fb380879d377e1eb7 Aug 17 07:20:53.056865 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-User-Name: admin Aug 17 07:20:53.056865 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: method: > Aug 17 07:20:53.056865 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: exception: Flavor 84 could not be found. Aug 17 07:20:53.056865 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: action_args: {'id': '84'} Aug 17 07:20:53.056865 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:20:53.056865 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:20:53.057836 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:20:53.059158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:20:53.059158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:20:53.059158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:20:53.059158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:20:53.059158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 07:20:53.059158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:20:53.059158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 17 07:20:53.059158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Aug 17 07:20:53.059158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:20:53.059158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Aug 17 07:20:53.059158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:20:53.059158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:20:53.059158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:20:53.059158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:20:53.059158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:20:53.059158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 17 07:20:53.059158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Aug 17 07:20:53.059158 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-76a53e3d-8d6b-4abd-ab75-abf0dd9d362a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:20:53.060479 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-76a53e3d-8d6b-4abd-ab75-abf0dd9d362a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.385145 Aug 17 07:20:53.060479 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 22/44] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 17 07:20:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:53.066710 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-58c82769-f7d7-4d37-a29d-c4a6d0a3a364 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:53.081150 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-58c82769-f7d7-4d37-a29d-c4a6d0a3a364 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017963 Aug 17 07:20:53.082310 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 23/45] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 17 07:20:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:20:53.091338 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-cac50753-2738-4643-bc49-35875aa16ba3 admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:53.106354 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-cac50753-2738-4643-bc49-35875aa16ba3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018416 Aug 17 07:20:53.106861 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 23/46] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 17 07:20:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:20:53.115930 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-20df25af-6694-44b4-a03f-524603508fd0 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:53.121186 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.wsgi [None req-20df25af-6694-44b4-a03f-524603508fd0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-20df25af-6694-44b4-a03f-524603508fd0 admin admin] Request method failure captured: Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Accept: application/json Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Accept-Encoding: gzip, deflate Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Connection: keep-alive Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Content-Length: 0 Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Host: 10.222.0.45 Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Openstack-Api-Version: compute 2.90 Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Openstack-System-Scope: None Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: User-Agent: python-novaclient Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Auth-Token: gAAAAABi_JbUW40Dv62IeLAdXiLwKOfejbkp_RKetlI741k8pczybFLnQjoPs5rQbA9SCUdyZiUsN-uR0HFnzbVZPZWlsxArFl43qxwvNLvgNu8mFSVEp_C_v6TK13pQCZSqM7FOS4aTUhus3Z6HHX9j_r9z2xNfrOfhBPXV_y6zLn_CEvnFUQ8 Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Domain-Id: None Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Domain-Name: None Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Identity-Status: Confirmed Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Is-Admin-Project: True Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Project-Domain-Id: default Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Project-Domain-Name: Default Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Project-Id: 93dca03ccb1d4c01b8cd3b051645d149 Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Project-Name: admin Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Role: member,admin,reader Aug 17 07:20:53.122680 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Roles: member,admin,reader Aug 17 07:20:53.124171 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_93dca03ccb1d4c01b8cd3b051645d149"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/93dca03ccb1d4c01b8cd3b051645d149"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/93dca03ccb1d4c01b8cd3b051645d149"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/93dca03ccb1d4c01b8cd3b051645d149"}]}] Aug 17 07:20:53.124171 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Tenant: admin Aug 17 07:20:53.124171 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Tenant-Id: 93dca03ccb1d4c01b8cd3b051645d149 Aug 17 07:20:53.124171 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Tenant-Name: admin Aug 17 07:20:53.124171 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-User: admin Aug 17 07:20:53.124171 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-User-Domain-Id: default Aug 17 07:20:53.124171 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-User-Domain-Name: Default Aug 17 07:20:53.124171 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-User-Id: 385e8184512a438fb380879d377e1eb7 Aug 17 07:20:53.124171 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-User-Name: admin Aug 17 07:20:53.124171 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: method: > Aug 17 07:20:53.124171 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: exception: Flavor 84 could not be found. Aug 17 07:20:53.124171 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: action_args: {'id': '84'} Aug 17 07:20:53.124171 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:20:53.124171 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:20:53.125252 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:20:53.126801 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:20:53.126801 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:20:53.126801 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:20:53.126801 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:20:53.126801 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 07:20:53.126801 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:20:53.126801 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 17 07:20:53.126801 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Aug 17 07:20:53.126801 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:20:53.126801 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Aug 17 07:20:53.126801 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:20:53.126801 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:20:53.126801 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:20:53.126801 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:20:53.126801 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:20:53.126801 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 17 07:20:53.126801 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Aug 17 07:20:53.126801 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-20df25af-6694-44b4-a03f-524603508fd0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:20:53.127988 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-20df25af-6694-44b4-a03f-524603508fd0 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011763 Aug 17 07:20:53.127988 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 24/47] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 17 07:20:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 17 07:20:54.084947 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-cac50753-2738-4643-bc49-35875aa16ba3 admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:54.085976 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-cac50753-2738-4643-bc49-35875aa16ba3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 17 07:20:54.086393 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 24/48] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 17 07:20:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:20:54.600735 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-04f4c907-82a8-4a54-9f03-9aa4403dcf0a admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:54.606588 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.wsgi [None req-04f4c907-82a8-4a54-9f03-9aa4403dcf0a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-04f4c907-82a8-4a54-9f03-9aa4403dcf0a admin admin] Request method failure captured: Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Accept: application/json Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Accept-Encoding: gzip, deflate Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Connection: keep-alive Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Content-Length: 0 Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Host: 10.222.0.45 Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Openstack-Api-Version: compute 2.90 Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Openstack-System-Scope: None Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: User-Agent: python-novaclient Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Auth-Token: gAAAAABi_JbV5aQ3YU3KNgYMzgNF4G5z_abF-E2hTr3G-boDeucivHd5Z0cIhkA9fPHZ9InajTQD0ole7Dg9GZeh7ZPpnaN92hl52BaQStvIamFFnsVjnLR9V7EFJXNblovx6VZg_tedtcWSoA1l0Pl7019JWVVhoMW7uCn2j1l8zhTiVLxs-Jo Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Domain-Id: None Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Domain-Name: None Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Identity-Status: Confirmed Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Is-Admin-Project: True Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Project-Domain-Id: default Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Project-Domain-Name: Default Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Project-Id: 93dca03ccb1d4c01b8cd3b051645d149 Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Project-Name: admin Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Role: member,admin,reader Aug 17 07:20:54.608067 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Roles: member,admin,reader Aug 17 07:20:54.609734 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_93dca03ccb1d4c01b8cd3b051645d149"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/93dca03ccb1d4c01b8cd3b051645d149"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/93dca03ccb1d4c01b8cd3b051645d149"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/93dca03ccb1d4c01b8cd3b051645d149"}]}] Aug 17 07:20:54.609734 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Tenant: admin Aug 17 07:20:54.609734 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Tenant-Id: 93dca03ccb1d4c01b8cd3b051645d149 Aug 17 07:20:54.609734 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-Tenant-Name: admin Aug 17 07:20:54.609734 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-User: admin Aug 17 07:20:54.609734 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-User-Domain-Id: default Aug 17 07:20:54.609734 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-User-Domain-Name: Default Aug 17 07:20:54.609734 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-User-Id: 385e8184512a438fb380879d377e1eb7 Aug 17 07:20:54.609734 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: X-User-Name: admin Aug 17 07:20:54.609734 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: method: > Aug 17 07:20:54.609734 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: exception: Flavor 451 could not be found. Aug 17 07:20:54.609734 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: action_args: {'id': '451'} Aug 17 07:20:54.609734 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:20:54.609734 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:20:54.610881 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:20:54.612314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:20:54.612314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:20:54.612314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:20:54.612314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:20:54.612314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 07:20:54.612314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:20:54.612314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 17 07:20:54.612314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Aug 17 07:20:54.612314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:20:54.612314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Aug 17 07:20:54.612314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:20:54.612314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:20:54.612314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:20:54.612314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:20:54.612314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:20:54.612314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 17 07:20:54.612314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: ERROR nova.api.openstack.wsgi Aug 17 07:20:54.612314 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-04f4c907-82a8-4a54-9f03-9aa4403dcf0a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:20:54.614357 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-04f4c907-82a8-4a54-9f03-9aa4403dcf0a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.384678 Aug 17 07:20:54.614357 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 25/49] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 17 07:20:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:54.619769 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-429e4766-cd08-41bb-a907-f15a1fe6a167 admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:54.634942 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-429e4766-cd08-41bb-a907-f15a1fe6a167 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018656 Aug 17 07:20:54.635452 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 25/50] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 17 07:20:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:20:54.644759 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-c9df0602-8cdd-4956-9ba4-9f9466014492 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:54.659241 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-c9df0602-8cdd-4956-9ba4-9f9466014492 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018027 Aug 17 07:20:54.660254 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 26/51] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 17 07:20:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:20:54.669049 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-e68f7d5a-a6d3-4753-857a-a1299b6461c8 admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:54.674247 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.wsgi [None req-e68f7d5a-a6d3-4753-857a-a1299b6461c8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-e68f7d5a-a6d3-4753-857a-a1299b6461c8 admin admin] Request method failure captured: Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Accept: application/json Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Accept-Encoding: gzip, deflate Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Connection: keep-alive Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Content-Length: 0 Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Host: 10.222.0.45 Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Openstack-Api-Version: compute 2.90 Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Openstack-System-Scope: None Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: User-Agent: python-novaclient Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Auth-Token: gAAAAABi_JbV5aQ3YU3KNgYMzgNF4G5z_abF-E2hTr3G-boDeucivHd5Z0cIhkA9fPHZ9InajTQD0ole7Dg9GZeh7ZPpnaN92hl52BaQStvIamFFnsVjnLR9V7EFJXNblovx6VZg_tedtcWSoA1l0Pl7019JWVVhoMW7uCn2j1l8zhTiVLxs-Jo Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Domain-Id: None Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Domain-Name: None Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Identity-Status: Confirmed Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Is-Admin-Project: True Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Project-Domain-Id: default Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Project-Domain-Name: Default Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Project-Id: 93dca03ccb1d4c01b8cd3b051645d149 Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Project-Name: admin Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Role: member,admin,reader Aug 17 07:20:54.676326 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Roles: member,admin,reader Aug 17 07:20:54.678022 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_93dca03ccb1d4c01b8cd3b051645d149"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/93dca03ccb1d4c01b8cd3b051645d149"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/93dca03ccb1d4c01b8cd3b051645d149"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/93dca03ccb1d4c01b8cd3b051645d149"}]}] Aug 17 07:20:54.678022 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Tenant: admin Aug 17 07:20:54.678022 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Tenant-Id: 93dca03ccb1d4c01b8cd3b051645d149 Aug 17 07:20:54.678022 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-Tenant-Name: admin Aug 17 07:20:54.678022 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-User: admin Aug 17 07:20:54.678022 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-User-Domain-Id: default Aug 17 07:20:54.678022 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-User-Domain-Name: Default Aug 17 07:20:54.678022 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-User-Id: 385e8184512a438fb380879d377e1eb7 Aug 17 07:20:54.678022 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: X-User-Name: admin Aug 17 07:20:54.678022 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: method: > Aug 17 07:20:54.678022 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: exception: Flavor 451 could not be found. Aug 17 07:20:54.678022 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: action_args: {'id': '451'} Aug 17 07:20:54.678022 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:20:54.678022 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:20:54.679218 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:20:54.680503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:20:54.680503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:20:54.680503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:20:54.680503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:20:54.680503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 07:20:54.680503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:20:54.680503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 17 07:20:54.680503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Aug 17 07:20:54.680503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:20:54.680503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Aug 17 07:20:54.680503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:20:54.680503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:20:54.680503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:20:54.680503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:20:54.680503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:20:54.680503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 17 07:20:54.680503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: ERROR nova.api.openstack.wsgi Aug 17 07:20:54.680503 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-e68f7d5a-a6d3-4753-857a-a1299b6461c8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:20:54.681739 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-e68f7d5a-a6d3-4753-857a-a1299b6461c8 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012028 Aug 17 07:20:54.681739 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 26/52] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 17 07:20:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 17 07:20:55.627841 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-c9df0602-8cdd-4956-9ba4-9f9466014492 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:55.628839 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-c9df0602-8cdd-4956-9ba4-9f9466014492 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 17 07:20:55.629224 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 27/53] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 17 07:20:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:20:56.145630 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-1bfbe97d-3ce1-4237-a752-b1b17f42cfc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:56.163863 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-1bfbe97d-3ce1-4237-a752-b1b17f42cfc5 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.397750 Aug 17 07:20:56.164391 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 27/54] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 17 07:20:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 07:20:57.112746 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-c9df0602-8cdd-4956-9ba4-9f9466014492 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:57.114307 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-c9df0602-8cdd-4956-9ba4-9f9466014492 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002250 Aug 17 07:20:57.114715 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 28/55] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 17 07:20:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:20:57.627252 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-2c91b7de-7dc8-4cf6-9a1b-6e101254def7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:57.646632 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-2c91b7de-7dc8-4cf6-9a1b-6e101254def7 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.396891 Aug 17 07:20:57.647168 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 28/56] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 17 07:20:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 07:20:58.610573 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-c9df0602-8cdd-4956-9ba4-9f9466014492 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:20:58.611593 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-c9df0602-8cdd-4956-9ba4-9f9466014492 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 17 07:20:58.611974 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 29/57] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 17 07:20:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:20:59.129052 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-e9243eab-0144-4b29-badf-94ea3c71eeae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:20:59.148461 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-e9243eab-0144-4b29-badf-94ea3c71eeae admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.398303 Aug 17 07:20:59.148993 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 29/58] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 17 07:20:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 07:21:00.115540 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-c9df0602-8cdd-4956-9ba4-9f9466014492 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:21:00.116541 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-c9df0602-8cdd-4956-9ba4-9f9466014492 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Aug 17 07:21:00.116932 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 30/59] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 17 07:21:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:21:00.632660 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-bdbba68f-3ddf-4287-9683-1fa42c56bb20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:21:00.651159 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-bdbba68f-3ddf-4287-9683-1fa42c56bb20 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.396110 Aug 17 07:21:00.651707 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 30/60] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 17 07:21:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 07:21:01.606258 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-c9df0602-8cdd-4956-9ba4-9f9466014492 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:21:01.607198 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-c9df0602-8cdd-4956-9ba4-9f9466014492 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 17 07:21:01.607599 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 31/61] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 17 07:21:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:21:02.121340 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-c144b379-7418-429e-b177-a79d2e3fcfae admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:21:02.141407 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-c144b379-7418-429e-b177-a79d2e3fcfae admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.396702 Aug 17 07:21:02.141927 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 31/62] 10.222.0.45 () {60 vars in 1202 bytes} [Wed Aug 17 07:21:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:21:54.653525 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-c9df0602-8cdd-4956-9ba4-9f9466014492 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:21:54.654474 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-c9df0602-8cdd-4956-9ba4-9f9466014492 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 17 07:21:54.654871 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 32/63] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 17 07:21:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:21:54.665976 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG dbcounter [-] [105538] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:55.035971 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-fc10a762-a39b-4b5d-91bf-c717dc564b43 admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:21:55.056194 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-fc10a762-a39b-4b5d-91bf-c717dc564b43 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.394977 Aug 17 07:21:55.056727 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 32/64] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 17 07:21:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:21:55.078472 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG dbcounter [-] [105539] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=105539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:55.082490 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-5591d845-7d92-4099-9dfe-ad6dd2af6d83 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:21:55.090725 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-5591d845-7d92-4099-9dfe-ad6dd2af6d83 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013678 Aug 17 07:21:55.091225 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 33/65] 10.222.0.45 () {60 vars in 1283 bytes} [Wed Aug 17 07:21:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:21:55.102669 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-7fdc34e7-5bdf-4c69-bd86-91c5812829e4 admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:21:55.110037 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-7fdc34e7-5bdf-4c69-bd86-91c5812829e4 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010871 Aug 17 07:21:55.110544 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 33/66] 10.222.0.45 () {60 vars in 1286 bytes} [Wed Aug 17 07:21:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:21:55.122087 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-0931c78f-7f56-44f4-a439-3cd0bd152871 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:21:55.130631 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-0931c78f-7f56-44f4-a439-3cd0bd152871 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011901 Aug 17 07:21:55.131127 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 34/67] 10.222.0.45 () {60 vars in 1286 bytes} [Wed Aug 17 07:21:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:21:55.142135 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-a1e79076-c3aa-4ec0-9fa1-75615d160dd9 admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:21:55.149434 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-a1e79076-c3aa-4ec0-9fa1-75615d160dd9 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010699 Aug 17 07:21:55.149935 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 34/68] 10.222.0.45 () {60 vars in 1283 bytes} [Wed Aug 17 07:21:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:24:51.562374 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-0931c78f-7f56-44f4-a439-3cd0bd152871 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:24:51.563374 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-0931c78f-7f56-44f4-a439-3cd0bd152871 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 17 07:24:51.563763 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 35/69] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 17 07:24:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:24:51.704295 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG dbcounter [-] [105538] Writing DB stats nova_api:SELECT=6 {{(pid=105538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:24:51.861914 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-6449c595-5e8c-44c2-b3a9-5e2b1240ba2a admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:24:51.864237 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:24:51.864237 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: warnings.warn(msg) Aug 17 07:24:51.865363 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-6449c595-5e8c-44c2-b3a9-5e2b1240ba2a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:24:51.866107 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-6449c595-5e8c-44c2-b3a9-5e2b1240ba2a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:24:51.866527 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-6449c595-5e8c-44c2-b3a9-5e2b1240ba2a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:24:51.867226 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-6449c595-5e8c-44c2-b3a9-5e2b1240ba2a admin admin] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:24:51.867673 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-6449c595-5e8c-44c2-b3a9-5e2b1240ba2a admin admin] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:24:51.868076 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-6449c595-5e8c-44c2-b3a9-5e2b1240ba2a admin admin] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:24:51.905015 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-6449c595-5e8c-44c2-b3a9-5e2b1240ba2a admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.202034 Aug 17 07:24:51.905592 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 35/70] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 17 07:24:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 07:24:52.739370 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-0931c78f-7f56-44f4-a439-3cd0bd152871 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:24:52.740361 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-0931c78f-7f56-44f4-a439-3cd0bd152871 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Aug 17 07:24:52.740745 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 36/71] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 17 07:24:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:24:52.928760 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-6015a511-2e90-48e6-bb56-d24e4bf58d9b admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:24:52.931146 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:24:52.931146 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: warnings.warn(msg) Aug 17 07:24:52.932238 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-6015a511-2e90-48e6-bb56-d24e4bf58d9b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:24:52.932718 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-6015a511-2e90-48e6-bb56-d24e4bf58d9b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:24:52.933146 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-6015a511-2e90-48e6-bb56-d24e4bf58d9b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:24:52.933889 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-6015a511-2e90-48e6-bb56-d24e4bf58d9b admin admin] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:24:52.934362 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-6015a511-2e90-48e6-bb56-d24e4bf58d9b admin admin] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:24:52.934783 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-6015a511-2e90-48e6-bb56-d24e4bf58d9b admin admin] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:24:52.954380 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-6015a511-2e90-48e6-bb56-d24e4bf58d9b admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076203 Aug 17 07:24:52.955537 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 36/72] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 17 07:24:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 07:25:04.185698 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-0931c78f-7f56-44f4-a439-3cd0bd152871 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:25:04.187273 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-0931c78f-7f56-44f4-a439-3cd0bd152871 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001703 Aug 17 07:25:04.187472 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 37/73] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 17 07:25:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:25:04.330426 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG dbcounter [-] [105538] Writing DB stats nova_cell0:SELECT=4 {{(pid=105538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:25:04.331679 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG dbcounter [-] [105538] Writing DB stats nova_cell1:SELECT=4 {{(pid=105538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:25:04.332292 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG dbcounter [-] [105538] Writing DB stats nova_api:SELECT=8 {{(pid=105538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:25:04.380121 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-37234cad-4196-4d97-b538-1ae814125b35 admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:25:04.382532 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:25:04.382532 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: warnings.warn(msg) Aug 17 07:25:04.383629 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-37234cad-4196-4d97-b538-1ae814125b35 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:25:04.384108 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-37234cad-4196-4d97-b538-1ae814125b35 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:25:04.384565 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-37234cad-4196-4d97-b538-1ae814125b35 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:25:04.385277 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-37234cad-4196-4d97-b538-1ae814125b35 admin admin] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:25:04.385724 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-37234cad-4196-4d97-b538-1ae814125b35 admin admin] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:25:04.386171 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-37234cad-4196-4d97-b538-1ae814125b35 admin admin] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:25:04.411647 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-37234cad-4196-4d97-b538-1ae814125b35 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085657 Aug 17 07:25:04.412188 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 37/74] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 17 07:25:04 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:25:05.228949 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: DEBUG nova.api.openstack.wsgi [None req-0931c78f-7f56-44f4-a439-3cd0bd152871 admin admin] Calling method '>' {{(pid=105539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:25:05.229952 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: INFO nova.api.openstack.requestlog [None req-0931c78f-7f56-44f4-a439-3cd0bd152871 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 17 07:25:05.230367 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: [pid: 105539|app: 0|req: 38/75] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 17 07:25:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:25:05.420138 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG nova.api.openstack.wsgi [None req-93514dbe-c144-4fe9-883c-5d71379382ae admin admin] Calling method '>' {{(pid=105538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:25:05.422530 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:25:05.422530 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: warnings.warn(msg) Aug 17 07:25:05.423611 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-93514dbe-c144-4fe9-883c-5d71379382ae admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:25:05.424073 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-93514dbe-c144-4fe9-883c-5d71379382ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:25:05.425064 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-93514dbe-c144-4fe9-883c-5d71379382ae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:25:05.425764 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-93514dbe-c144-4fe9-883c-5d71379382ae admin admin] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:25:05.426224 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-93514dbe-c144-4fe9-883c-5d71379382ae admin admin] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:25:05.426633 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: DEBUG oslo_concurrency.lockutils [None req-93514dbe-c144-4fe9-883c-5d71379382ae admin admin] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:25:05.447643 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: INFO nova.api.openstack.requestlog [None req-93514dbe-c144-4fe9-883c-5d71379382ae admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078411 Aug 17 07:25:05.448110 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: [pid: 105538|app: 0|req: 38/76] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 17 07:25:05 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:26:01.400032 dv-cinder-853126-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 17 07:26:01.400605 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: Wed Aug 17 07:26:01 2022 - graceful shutdown triggered... Aug 17 07:26:01.401058 dv-cinder-853126-2-iscsi devstack@n-api.service[105538]: Gracefully killing worker 1 (pid: 105538)... Aug 17 07:26:01.402033 dv-cinder-853126-2-iscsi devstack@n-api.service[105539]: Gracefully killing worker 2 (pid: 105539)... Aug 17 07:26:02.401618 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: worker 1 buried after 1 seconds Aug 17 07:26:02.401618 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: worker 2 buried after 1 seconds Aug 17 07:26:02.401618 dv-cinder-853126-2-iscsi devstack@n-api.service[105537]: goodbye to uWSGI. Aug 17 07:26:02.403114 dv-cinder-853126-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 17 07:26:02.403671 dv-cinder-853126-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 17 07:26:02.406469 dv-cinder-853126-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 17 07:26:02.418027 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 17 07:26:02.420678 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 07:26:02 2022] *** Aug 17 07:26:02.420678 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 07:26:02.420678 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 07:26:02.420678 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: nodename: dv-cinder-853126-2-iscsi Aug 17 07:26:02.420678 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: machine: x86_64 Aug 17 07:26:02.420678 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: clock source: unix Aug 17 07:26:02.420678 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: pcre jit disabled Aug 17 07:26:02.420678 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: detected number of CPU cores: 4 Aug 17 07:26:02.420678 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: current working directory: / Aug 17 07:26:02.420678 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: detected binary path: /usr/bin/uwsgi-core Aug 17 07:26:02.420678 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: your processes number limit is 47680 Aug 17 07:26:02.421533 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: your memory page size is 4096 bytes Aug 17 07:26:02.421533 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: detected max file descriptor number: 2048 Aug 17 07:26:02.421533 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: lock engine: pthread robust mutexes Aug 17 07:26:02.421533 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: thunder lock: enabled Aug 17 07:26:02.421533 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 17 07:26:02.421533 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 07:26:02.461225 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: Python main interpreter initialized at 0x5602aa3799c0 Aug 17 07:26:02.461225 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: python threads support enabled Aug 17 07:26:02.461225 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: your server socket listen backlog is limited to 100 connections Aug 17 07:26:02.461225 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: your mercy for graceful operations on workers is 90 seconds Aug 17 07:26:02.461604 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 07:26:02.461604 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: *** Operational MODE: preforking *** Aug 17 07:26:02.461755 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: *** uWSGI is running in multiple interpreter mode *** Aug 17 07:26:02.461755 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: spawned uWSGI master process (pid: 120820) Aug 17 07:26:02.461915 dv-cinder-853126-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 17 07:26:02.463967 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: spawned uWSGI worker 1 (pid: 120834, cores: 1) Aug 17 07:26:02.463967 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: spawned uWSGI worker 2 (pid: 120835, cores: 1) Aug 17 07:26:02.463967 dv-cinder-853126-2-iscsi devstack@n-api.service[120820]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 07:26:03.133721 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 07:26:03.143264 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 07:26:04.290394 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 07:26:04.290394 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: from cryptography.utils import int_from_bytes Aug 17 07:26:04.291058 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 07:26:04.291058 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: from cryptography.utils import int_from_bytes Aug 17 07:26:04.294864 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 07:26:04.294864 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: from cryptography.utils import int_from_bytes Aug 17 07:26:04.295408 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 07:26:04.295408 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: from cryptography.utils import int_from_bytes Aug 17 07:26:06.576404 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 07:26:06.577018 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 07:26:06.577289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 07:26:06.577535 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 07:26:06.577792 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 07:26:06.578210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.578543 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.578868 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.579192 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.579525 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.579840 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.580161 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.580485 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.580817 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.581102 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.581974 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.582307 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853126-2-iscsi {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.582629 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.582940 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.583253 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.583552 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 07:26:06.583945 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.584029 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 07:26:06.584109 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.584191 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.584381 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 07:26:06.584529 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.584697 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 07:26:06.584961 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 07:26:06.586543 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.586804 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.587039 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.587264 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.587485 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.587704 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.587928 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.588148 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.588362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.588566 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.588793 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.589011 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.589232 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.589444 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.589648 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.589862 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.590106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.590106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.590528 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.590528 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.590953 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.591171 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.591395 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853126-2-iscsi {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.591622 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853126-2-iscsi {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.591837 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.592022 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.592210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.592404 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.592558 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.592712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.592889 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.593053 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.593197 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.593352 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.593535 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.593687 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.593853 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.594034 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.594194 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.594194 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.594529 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.594529 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.594896 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.595503 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.595700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.595866 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.596016 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.596016 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.596345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.596510 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.596666 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.596826 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.596970 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.597121 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.597279 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.597466 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.597649 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.597809 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.597987 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.598160 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.598386 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.598544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.598696 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853126-2-iscsi {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.598839 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.598989 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.599131 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.599287 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.599438 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.599594 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.599737 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.599737 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.600036 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.600188 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.600349 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.600500 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.600652 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.600801 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.600945 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.601097 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.601251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.601404 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.601548 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.601697 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.601859 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.602034 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.602198 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.602348 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.602498 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.602642 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.602792 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.602943 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.603091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.603234 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.603382 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.603532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.603675 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.603837 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.603990 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.604133 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.604291 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.604441 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.604590 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.604746 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.604890 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.605039 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.605674 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.605826 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.606116 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.606277 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.606474 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.606636 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.606792 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.606946 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.607098 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.607250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.607392 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.607541 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.607693 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.607850 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.607998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.608159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.608302 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.608452 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.608604 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.608762 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.608913 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.609055 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.609204 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.609388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.609543 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.609698 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.609848 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.610029 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.610188 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.610331 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.610483 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.610640 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.610793 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.610937 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.611085 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.611234 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.611384 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.611575 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.611729 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.611872 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.612014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.612172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.612172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.612452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.612452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.612739 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.612892 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.613044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.613044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.613329 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.613480 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.613623 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.613771 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.613931 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.614110 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.614265 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.614415 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.614563 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.614706 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.614847 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.615008 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.615152 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.615778 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.615947 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.616098 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.616556 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.616717 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.616860 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.617010 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.617152 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.617310 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.617463 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.617606 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.617754 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.617904 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.618091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.618244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.618386 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.618535 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.618694 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.618847 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.618997 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.619139 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.619291 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.619435 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.619585 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.619740 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.619883 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.620025 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.620173 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.620315 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.620464 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.620628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.620782 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.620925 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.621077 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.621225 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.621381 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.621531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.621672 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.621821 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.621989 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.622148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.622305 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.622456 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.622616 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.622759 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.622910 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.623061 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.623216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.623359 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.623502 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.623655 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.623798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.623954 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.624115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.624267 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.624419 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.624577 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.624727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.624877 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.625026 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.625169 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.625317 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.625993 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.626155 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.626317 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.626469 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.626663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.626824 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.626979 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.627121 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.627274 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.627417 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.627565 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.627722 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.627867 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.628507 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.628652 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.628794 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.628936 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.629092 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.629242 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.629402 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.629551 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.629701 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.629701 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.630019 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.630174 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.630325 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.630468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.630616 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.630772 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.630923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.631065 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.631224 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.631374 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.631524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.631679 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.631822 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.632137 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.632292 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.632442 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.632600 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.632757 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.632908 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.633052 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.633200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.633363 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.633515 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.633658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:26:06.633811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.634021 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.634181 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.634333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.634486 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.634635 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.634784 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.634933 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.635087 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.636734 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.636908 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.637071 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.637233 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.637383 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.637527 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.637677 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.637820 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.638013 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.638163 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.638163 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.638454 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.638608 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.638762 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.638762 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.639050 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.639191 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.639334 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.639476 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.639631 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.639773 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.639925 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.639925 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.640201 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.640344 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.640495 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.640655 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.640798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.640946 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.641096 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.641238 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.641390 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.641532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.641682 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.641831 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.642019 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.642180 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.642332 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.642483 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.642643 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.642787 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.642938 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.643095 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.643245 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.643396 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.643546 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.644315 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.644465 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.644617 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.644767 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.644911 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.645061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.645223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.645374 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.645528 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.645678 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.646169 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.646322 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.646466 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.646867 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.647030 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.647183 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.647326 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.647475 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.647636 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.647779 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.647930 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.648073 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.648215 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.648364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.648513 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.648667 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.648811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.648952 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.649094 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.649235 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.649377 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.649542 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.649685 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.649835 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.650007 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.650157 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.650311 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.650311 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.650596 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.650739 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.650881 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.651030 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.651172 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.651324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.651477 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.651619 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.651760 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.651903 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.652096 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.652256 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.652408 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.652558 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.652700 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.652841 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.652998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.653141 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.653289 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.653444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.653586 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.653728 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.653895 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.654107 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.654268 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.654268 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.654555 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.654555 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.654840 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.654840 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.655121 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.655272 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.655415 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.655567 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.655794 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.656270 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.656421 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.656564 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.656706 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.657068 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.657225 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.657225 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.657506 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.657648 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.657801 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.657978 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.658131 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.658275 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.658427 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.658579 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.658721 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.658873 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.659024 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.659176 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.659358 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.659509 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.659661 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.659815 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.659958 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.660108 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.660258 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.660408 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.660563 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.660713 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.660863 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.661006 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.661154 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.661297 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.661454 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.661606 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.661763 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.661906 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.662127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.662283 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.662436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.662580 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.662728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.662878 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.663027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.663178 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.663987 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.664152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.664327 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.664483 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.664626 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.664849 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.665002 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.665152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.665301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.665454 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.665596 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.665752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.665894 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.666450 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.666601 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.666757 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.666909 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.667278 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.667435 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.667435 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.667732 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.667883 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.668035 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.668188 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.668332 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.668481 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.668625 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.668774 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.668937 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.669082 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.669234 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.669376 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.669525 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.669675 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.669839 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.670008 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.670157 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.670319 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.670470 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.670619 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.670776 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.670945 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.671101 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.671101 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.671371 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.671371 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.671655 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.671798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.671947 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.672090 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.672232 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.672383 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.672526 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.672674 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.672829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.672971 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.673119 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.673274 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.673424 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.673424 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.673700 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.673843 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.674003 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.674163 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.674317 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.674461 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.674617 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.674769 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.674950 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.674950 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.675243 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.675386 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.675529 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.675529 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.675805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.675950 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.676092 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.676564 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.676722 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.676878 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.677031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.677200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.677614 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.677760 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.677903 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.678106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.678265 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.678415 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.678558 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.678709 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.678859 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.679002 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.679169 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.679313 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.679462 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.679605 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.679757 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.679915 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.680064 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.680215 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.680363 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.680506 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.680655 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.680812 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.680962 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.681130 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.681281 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.681425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.681566 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.681717 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.681861 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.682028 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.682178 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.682322 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.682474 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.682631 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.682774 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.682917 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.683069 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.683211 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.683364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.683514 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.683656 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.683798 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.683940 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.684082 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.684239 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.684388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.684532 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.684685 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.684845 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.684988 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.685139 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.685432 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.685582 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.685725 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.685874 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.686171 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.686705 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.686860 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.687003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.687154 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.687327 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.687694 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.687854 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.687998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.688142 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.688284 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.688440 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.688592 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.688735 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.688877 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.689027 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.689177 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.689341 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.689510 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.689669 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.689825 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.689993 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.690158 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.690321 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.691017 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.691176 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.691325 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.691473 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.691623 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.691781 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.691932 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.692098 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.692248 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.692405 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.692567 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.692726 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.692884 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.692884 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.693168 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.693317 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.693493 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.693700 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.693861 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.694100 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.694258 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.694453 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.694621 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.694779 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.694940 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.695091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.695239 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.695401 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.695551 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.695743 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.695899 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.696049 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.696222 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.696387 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.696890 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.697055 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.697214 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.697377 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.697582 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.697926 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.698121 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.698272 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.698592 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.698772 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.698926 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.699099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.699258 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.699416 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.699577 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.699739 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.699896 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.700055 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.700206 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.700355 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.700579 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.700731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.700887 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.701037 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.701198 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.701198 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.701503 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.701660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.701816 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.701987 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.702144 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.702310 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.702475 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.702632 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.702782 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.702930 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.703090 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.703251 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.703409 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.703566 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.703716 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.703864 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.704012 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.704174 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.704335 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.704493 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.704657 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.704825 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.704977 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.705136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.705286 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.705436 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.705593 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.705751 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.705908 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.706151 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.707107 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.707266 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.707495 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.707696 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.707877 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.708198 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.708369 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.708522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.708680 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.708841 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.708999 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.709155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.709312 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.709512 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.709674 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.709824 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.709999 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.710155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.710316 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.710478 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.710638 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.710789 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.710939 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.711089 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.711243 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.711243 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.711587 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.711750 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.711908 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.712058 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.712207 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.712388 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.712539 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.712697 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.712847 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.712847 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.713152 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.713311 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.713470 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.713620 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.713771 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.713920 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.714112 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.714253 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.714391 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.714530 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.714661 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.714796 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.714935 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.715065 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.715195 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.715325 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.715461 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.715600 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.715739 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.715871 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.716008 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.716139 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.716276 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.716419 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.716557 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.716688 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.716817 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.717277 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.717419 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.717564 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.717745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.717885 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.718045 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.718332 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.718467 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.718612 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.718744 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.718874 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.719005 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.719141 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.719272 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.719272 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.719521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.719653 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.719790 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.719927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.720072 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.720202 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.720383 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.720383 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.720630 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.720760 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.720903 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.721042 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.721179 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.721310 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.721446 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.721584 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.721749 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.721889 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.722071 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.722202 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.722344 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.722482 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.722626 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.722765 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.722902 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.723033 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.723164 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.723303 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.723441 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.723578 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.723709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.723847 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.723977 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.723977 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.724241 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.724378 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.724515 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.724645 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.724778 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.724920 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.725058 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.725058 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.725312 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.725312 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.725312 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.725702 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.725840 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.725840 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.726102 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.726231 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.726231 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.726503 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.726633 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.726633 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.726895 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.727348 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.727348 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.727614 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.727790 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.727923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.728052 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.728052 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.728488 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.728633 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.728765 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.728895 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.728895 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.729155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.729298 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.729298 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.729555 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.729692 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.729692 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.729999 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.730131 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.730131 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.730376 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.730517 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.730517 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.730781 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.730911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.730911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.731164 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.731300 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.731429 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.731568 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.731568 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.731821 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.731957 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.731957 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.732220 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.732358 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.732497 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.732726 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.732726 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.732726 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.733088 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.733226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.733364 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.733494 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.733494 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.733749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.733890 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.733890 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.734153 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.734282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.734423 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.734554 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.734554 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.734890 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.735020 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.735157 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.735294 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.735294 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.735548 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.735679 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.735679 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.735930 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.736061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.736061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.736317 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.736448 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.736448 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.736701 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.736847 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.736986 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.737454 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.737454 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.737721 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.737896 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.737896 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.738195 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.738333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.738478 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.738707 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.738707 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.739047 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.739196 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.739328 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.739464 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.739464 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.739726 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.739856 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.739856 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.740112 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.740249 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.740249 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.740503 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.740651 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.740651 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.740904 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.741035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.741173 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.741557 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.741557 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.741820 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.741950 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.741950 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.742235 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.742372 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.742372 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.742628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.742757 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.742885 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.743026 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.743157 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.743295 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.743295 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.743540 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.743669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.743797 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.743935 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.743935 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.743935 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.744322 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.744451 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.744580 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.744717 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.744717 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.744965 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.745095 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.745225 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.745354 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.745354 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.745616 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.745754 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.745754 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.746057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.746190 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.746332 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.746470 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.746470 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.746723 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.746852 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.746852 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.747111 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.747572 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.747572 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.747833 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.748008 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.748149 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.748281 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.748281 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.748535 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.748688 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.748688 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.749125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.749272 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.749417 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.749548 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.749548 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.749803 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.749933 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.750089 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.750220 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.750220 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.750484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.750615 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.750615 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.750869 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.751007 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.751137 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.751275 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.751275 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.751537 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.751666 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.751666 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.751932 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.752070 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.752070 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.752316 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.752453 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.752453 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.752707 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.752844 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.753491 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.753627 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.753627 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.753889 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.754078 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.754078 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.754427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.754556 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.754684 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.754824 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.754824 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.755155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.755285 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.755285 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.755535 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.755673 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.755673 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.755924 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.756052 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.756226 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.756360 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.756559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.756725 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.756886 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.757185 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.757318 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.757764 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.757914 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.758108 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.758249 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.758380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.758511 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.758700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.758848 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.759179 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.759320 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.759458 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.759625 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.759771 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.760053 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.760184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.760368 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.760557 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.760700 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.760974 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.761107 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.761283 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.761455 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.761596 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.761888 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.762080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.762221 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.762406 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.762541 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.762830 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.762963 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.763142 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.763322 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.763455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.763752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.763893 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.764064 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.764253 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.764394 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.765091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.765229 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.765368 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.765500 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.765637 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.765637 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.765900 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.766103 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.766235 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.766407 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.766557 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.766871 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.767007 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.767189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.767408 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.767901 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.768039 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.768223 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.768223 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.768481 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.768664 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.769483 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.769615 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.769615 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.769872 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.770050 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.770252 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.770393 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.770709 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.770850 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.771142 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.771274 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.771465 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.771621 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.771767 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.772066 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.772207 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.772393 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.772549 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.772713 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.773030 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.773336 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.773471 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.773650 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.773824 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.773998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.774302 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.774437 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.774629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.774959 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.775098 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.775299 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.775544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.775687 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.775934 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.776074 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.776252 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.776474 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.776616 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.776920 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.777056 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.777239 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.777426 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.778091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.778282 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.778428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.778568 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.778707 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.778707 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.778965 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.779104 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.779104 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.779699 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.779842 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.779982 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.780124 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.780255 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.780385 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.780385 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.780630 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.780772 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.780904 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.781040 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.781177 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.781307 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.781449 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.781586 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.781724 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.781855 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.782013 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.782188 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.782336 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.782507 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.782647 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.782828 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.782969 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.783159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.783365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.783499 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.783692 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.783832 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.784035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.784175 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.784398 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.784539 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.784732 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.784872 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.785057 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.785205 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.785371 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.785518 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.785699 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.785839 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.786036 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.786185 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.786352 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.786533 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.786672 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.786810 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.786975 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.787119 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.787283 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.787423 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.787600 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.787739 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.787950 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.788172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.788410 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.788552 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.788552 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.788808 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.788951 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.789082 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.789213 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.789343 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.789680 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.789824 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.790021 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.790169 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.790353 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.790493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.790678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.790821 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.790999 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.791143 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.791308 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.791441 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.791625 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.791767 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.791936 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.792069 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.792249 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.792392 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.792573 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.792717 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.792886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.793021 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.793196 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.793330 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.793508 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.793652 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.793825 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.794019 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.794166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.794299 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.794467 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.794634 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.794785 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.794926 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.795096 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.795237 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.795417 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.795551 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.795751 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.795887 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.796027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.796168 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.796333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.796470 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.796653 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.796797 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.796962 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.797106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.797271 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.797412 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.797581 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.797725 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.797890 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.798156 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.798290 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.798518 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.798518 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.798781 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.798911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.799055 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.799194 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.799325 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.799459 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.799589 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.799911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.800061 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.800194 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.800338 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.800470 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.800607 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.800750 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.800882 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.801012 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.801143 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.801308 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.801444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.801633 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.801769 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.801951 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.802224 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.802360 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.802542 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.802690 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.802881 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.803026 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.803253 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.803395 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.803578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.803714 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.803934 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.804122 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.804244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.804467 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.804603 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.804799 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.804921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.805141 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.805263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.805466 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.805593 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.805778 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.805899 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.806111 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.806233 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.806427 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.806559 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.806760 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.806882 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.807080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.807201 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.807400 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.807521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.809033 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.809202 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.809202 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.809457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.809638 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.809771 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.810104 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.810243 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.810357 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.810468 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.810594 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.810723 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.810843 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.810964 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.810964 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.811184 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.811184 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.811410 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.811410 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.811714 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.811846 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.811986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.812126 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.812265 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.812403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.812535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.812672 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.812812 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.812812 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.813059 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.813059 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.813322 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.813453 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.813598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.813730 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.813868 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.814052 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.814185 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.814324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.814457 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.814595 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.814727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.814865 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.814995 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.815135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.815273 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.815413 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.816072 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.816213 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.816343 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.816483 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.816616 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.816746 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.816883 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.817023 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.817153 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.817292 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.817430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.817562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.817692 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.817821 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.818030 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.818172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.818304 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.818428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.818560 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.818689 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.818858 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.819162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.819304 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.819435 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.819565 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.819704 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.819845 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.819976 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.820287 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.820429 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.820561 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.820706 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.820838 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.821025 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.821164 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.821343 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.821479 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.821673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.821816 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.822012 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.822149 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.822332 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.822474 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.822645 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.822788 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.822956 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.823090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.823266 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.823515 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.823659 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.823855 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.823990 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.824176 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.824309 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.824485 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.824628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.824796 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.824938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.825111 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.825253 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.825421 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.825563 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.825730 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.825870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.826062 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.826197 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.826372 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.826514 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.826683 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.826818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.826991 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.827134 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.827303 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.827436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.827609 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.827742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.827920 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.828067 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.828224 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.828357 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.828533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.828680 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.828842 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.828989 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.829166 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.829317 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.829487 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.829601 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.829798 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.829935 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.830135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.830256 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.830451 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.830555 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.830768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.830872 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.831122 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.831725 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.831958 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.832054 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.832288 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.832386 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.832613 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.832709 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.832930 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.833033 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.833271 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.833369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.833586 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.833687 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.833901 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.834039 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.834243 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.834338 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.834559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.834662 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.834877 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.834981 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.835196 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.835295 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.835505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.835609 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.835850 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.836066 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.836183 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.836471 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.836573 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.836794 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.836949 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.837122 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.837376 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.837479 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.837753 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.837887 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.838137 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.838254 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.838524 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.838924 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.839030 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.839107 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.839198 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.839466 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.839585 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.839800 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.839932 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.840122 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.840369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.840479 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.840782 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.840901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.841110 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.841216 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.841437 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.841659 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.841773 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.842104 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.842223 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.842421 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.842761 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.843024 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.843127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.843428 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.843541 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.843824 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.843920 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.844226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.844411 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.844593 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.844757 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.844916 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.845070 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.845223 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.845368 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.845519 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.845673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.845819 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 07:26:06.845984 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.846201 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.846514 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.846854 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.847174 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.847485 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.847797 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.848107 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.848415 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.848726 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.849040 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.849355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.849667 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.850062 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.850307 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.850617 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.850931 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.851279 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.851622 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.851946 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.852275 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.852595 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.852924 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.853241 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.853569 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.853896 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.854305 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.854624 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.854964 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.855281 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.855607 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.855917 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.856231 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.856546 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.856859 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.857198 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.857528 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.857841 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.858199 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.858529 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.858854 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.859182 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.859498 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.859832 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.860144 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.860460 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.860773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.861094 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.861408 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.861727 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.862066 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.862913 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.863237 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.863558 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.863893 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.864224 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.864538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.864893 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.865225 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.865584 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.865903 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.866548 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.866882 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.867204 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.867521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.867833 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:26:06.868080 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 07:26:06.997580 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO dbcounter [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] Registered counter for database nova_api Aug 17 07:26:07.018804 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_db.sqlalchemy.engines [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120834) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 07:26:07.022263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO dbcounter [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] Registered counter for database nova_api Aug 17 07:26:07.025460 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writer thread running {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 07:26:07.041836 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_db.sqlalchemy.engines [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 07:26:07.048464 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writer thread running {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 07:26:07.082319 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.context [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e30419f5-f844-4338-aa4e-6c29191d9231(cell1) {{(pid=120834) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 07:26:07.086357 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:26:07.086832 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:26:07.088398 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:26:07.089153 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:26:07.089602 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:26:07.091621 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:26:07.093658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO dbcounter [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] Registered counter for database nova_cell0 Aug 17 07:26:07.098083 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO dbcounter [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] Registered counter for database nova_cell1 Aug 17 07:26:07.105405 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_db.sqlalchemy.engines [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120834) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 07:26:07.106468 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.context [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e30419f5-f844-4338-aa4e-6c29191d9231(cell1) {{(pid=120835) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 07:26:07.110560 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writer thread running {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 07:26:07.110726 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:26:07.111035 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:26:07.111214 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_db.sqlalchemy.engines [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120834) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 07:26:07.113164 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:26:07.113919 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:26:07.114396 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:26:07.116642 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:26:07.118837 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO dbcounter [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] Registered counter for database nova_cell0 Aug 17 07:26:07.126568 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO dbcounter [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] Registered counter for database nova_cell1 Aug 17 07:26:07.136113 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_db.sqlalchemy.engines [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 07:26:07.137954 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_db.sqlalchemy.engines [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 07:26:07.143621 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writer thread running {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 07:26:07.146169 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writer thread running {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 07:26:07.253262 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writer thread running {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 07:26:07.262288 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO dbcounter [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] Registered counter for database nova_cell0 Aug 17 07:26:07.269228 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_db.sqlalchemy.engines [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120834) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 07:26:07.273691 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writer thread running {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 07:26:07.293571 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO dbcounter [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] Registered counter for database nova_cell0 Aug 17 07:26:07.302175 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_db.sqlalchemy.engines [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 07:26:07.307123 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writer thread running {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 07:26:07.594488 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: WARNING keystonemiddleware.auth_token [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 07:26:07.602434 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: WARNING keystonemiddleware.auth_token [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 07:26:07.624887 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: WARNING keystonemiddleware.auth_token [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 07:26:07.632843 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: WARNING keystonemiddleware.auth_token [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 07:26:07.946173 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: WARNING keystonemiddleware.auth_token [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 07:26:07.952177 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: WARNING keystonemiddleware.auth_token [None req-7281fea9-b508-42d3-84f2-c8558e574e27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 07:26:07.958694 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5602aa3799c0 pid: 120834 (default app) Aug 17 07:26:07.972693 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: WARNING keystonemiddleware.auth_token [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 07:26:07.978768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: WARNING keystonemiddleware.auth_token [None req-5d7fcfa4-ca44-41cb-946e-71b4dba45ee1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 07:26:07.985036 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5602aa3799c0 pid: 120835 (default app) Aug 17 07:26:42.236948 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=3 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:42.238605 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=3 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:42.239391 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=3 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:42.240482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=3 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:42.646845 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=3 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:42.647876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=3 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:42.648851 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=3 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:42.649757 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=3 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:43.641047 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-da2bf5c0-48d7-4114-b7b8-cdd25759fe57 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Action: 'create', calling method: .version_select at 0x7f30ae358310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1162056937"}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:26:43.819284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-fdba7ecd-ea00-432f-bed9-c921f75239f1 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] Action: 'create', calling method: .version_select at 0x7f30ae357310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-232749381", "metadata": {"Type": "work"}}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-fdba7ecd-ea00-432f-bed9-c921f75239f1 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] Request method failure captured: Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 121 Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_Jgyv0hCbGYXGP06FWtTXkpJnpk7PJzjdQlB7KkhZYc7PiR5wgy3HHSh9lU122Gy_JWRpl7_4rGgkLrzw9yk-OBfoZgpPhnZQdgVvCVCsC_2mjO1-QGslJrXGOTuKmt9UKH2Eh70CMcsKCKZX2BLLTAA1fqn097CeDr1KS5RSBcVMlI Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 9a03094fc4d642eba293cbb9b8441165 Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-VolumesNegativeTest-269026327 Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:26:43.825994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:26:43.827958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9a03094fc4d642eba293cbb9b8441165"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9a03094fc4d642eba293cbb9b8441165"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9a03094fc4d642eba293cbb9b8441165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9a03094fc4d642eba293cbb9b8441165"}]}] Aug 17 07:26:43.827958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-VolumesNegativeTest-269026327 Aug 17 07:26:43.827958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 9a03094fc4d642eba293cbb9b8441165 Aug 17 07:26:43.827958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-VolumesNegativeTest-269026327 Aug 17 07:26:43.827958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-VolumesNegativeTest-269026327-project Aug 17 07:26:43.827958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:26:43.827958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:26:43.827958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: 65a8f63cfd304811a4feb48ea9776ec0 Aug 17 07:26:43.827958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-VolumesNegativeTest-269026327-project Aug 17 07:26:43.827958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Aug 17 07:26:43.827958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-232749381", "metadata": {"Type": "work"}}} Aug 17 07:26:43.827958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: Aug 17 07:26:43.827958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-232749381', 'metadata': {'Type': 'work'}}}} Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise error Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi '#$%' Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:26:43.829057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 07:26:43.831268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 07:26:43.832614 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 07:26:43.832614 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.835352 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-fdba7ecd-ea00-432f-bed9-c921f75239f1 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:26:43.836642 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-fdba7ecd-ea00-432f-bed9-c921f75239f1 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.201566 Aug 17 07:26:43.837829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 17 07:26:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 17 07:26:43.852065 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-1d72c696-1e90-4693-8a46-615491ef12ff tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] Action: 'create', calling method: .version_select at 0x7f30ae357f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1396227904", "metadata": {"Type": "work"}}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-1d72c696-1e90-4693-8a46-615491ef12ff tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] Request method failure captured: Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 120 Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_Jgyv0hCbGYXGP06FWtTXkpJnpk7PJzjdQlB7KkhZYc7PiR5wgy3HHSh9lU122Gy_JWRpl7_4rGgkLrzw9yk-OBfoZgpPhnZQdgVvCVCsC_2mjO1-QGslJrXGOTuKmt9UKH2Eh70CMcsKCKZX2BLLTAA1fqn097CeDr1KS5RSBcVMlI Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 9a03094fc4d642eba293cbb9b8441165 Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-VolumesNegativeTest-269026327 Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:26:43.856562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:26:43.858184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9a03094fc4d642eba293cbb9b8441165"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9a03094fc4d642eba293cbb9b8441165"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9a03094fc4d642eba293cbb9b8441165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9a03094fc4d642eba293cbb9b8441165"}]}] Aug 17 07:26:43.858184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-VolumesNegativeTest-269026327 Aug 17 07:26:43.858184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 9a03094fc4d642eba293cbb9b8441165 Aug 17 07:26:43.858184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-VolumesNegativeTest-269026327 Aug 17 07:26:43.858184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-VolumesNegativeTest-269026327-project Aug 17 07:26:43.858184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:26:43.858184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:26:43.858184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: 65a8f63cfd304811a4feb48ea9776ec0 Aug 17 07:26:43.858184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-VolumesNegativeTest-269026327-project Aug 17 07:26:43.858184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Aug 17 07:26:43.858184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1396227904", "metadata": {"Type": "work"}}} Aug 17 07:26:43.858184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: Aug 17 07:26:43.858184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1396227904', 'metadata': {'Type': 'work'}}}} Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise error Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi '0' Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:26:43.859347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 07:26:43.860886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 07:26:43.862400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 07:26:43.862400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.862400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-1d72c696-1e90-4693-8a46-615491ef12ff tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:26:43.862400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-1d72c696-1e90-4693-8a46-615491ef12ff tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011530 Aug 17 07:26:43.862400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 2/2] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 17 07:26:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 17 07:26:43.884476 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-60c4a46a-e07c-4333-aa8b-8102b8b80761 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] Action: 'create', calling method: .version_select at 0x7f30ae261ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1568752124", "metadata": {"Type": "work"}}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-60c4a46a-e07c-4333-aa8b-8102b8b80761 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] Request method failure captured: Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 119 Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_Jgyv0hCbGYXGP06FWtTXkpJnpk7PJzjdQlB7KkhZYc7PiR5wgy3HHSh9lU122Gy_JWRpl7_4rGgkLrzw9yk-OBfoZgpPhnZQdgVvCVCsC_2mjO1-QGslJrXGOTuKmt9UKH2Eh70CMcsKCKZX2BLLTAA1fqn097CeDr1KS5RSBcVMlI Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 9a03094fc4d642eba293cbb9b8441165 Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-VolumesNegativeTest-269026327 Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:26:43.890044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:26:43.891427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9a03094fc4d642eba293cbb9b8441165"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9a03094fc4d642eba293cbb9b8441165"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9a03094fc4d642eba293cbb9b8441165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9a03094fc4d642eba293cbb9b8441165"}]}] Aug 17 07:26:43.891427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-VolumesNegativeTest-269026327 Aug 17 07:26:43.891427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 9a03094fc4d642eba293cbb9b8441165 Aug 17 07:26:43.891427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-VolumesNegativeTest-269026327 Aug 17 07:26:43.891427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-VolumesNegativeTest-269026327-project Aug 17 07:26:43.891427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:26:43.891427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:26:43.891427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: 65a8f63cfd304811a4feb48ea9776ec0 Aug 17 07:26:43.891427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-VolumesNegativeTest-269026327-project Aug 17 07:26:43.891427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Aug 17 07:26:43.891427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1568752124", "metadata": {"Type": "work"}}} Aug 17 07:26:43.891427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: Aug 17 07:26:43.891427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1568752124', 'metadata': {'Type': 'work'}}}} Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise error Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi '' Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:26:43.892193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 07:26:43.897532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 07:26:43.900086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 07:26:43.900086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:43.900086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-60c4a46a-e07c-4333-aa8b-8102b8b80761 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:26:43.900086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-60c4a46a-e07c-4333-aa8b-8102b8b80761 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015538 Aug 17 07:26:43.900615 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 3/3] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 17 07:26:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 07:26:43.907532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-138bcfd9-e722-4b65-9850-5f817a0e6b71 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] Calling method '.version_select at 0x7f30ae261c10>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:44.449478 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-138bcfd9-e722-4b65-9850-5f817a0e6b71 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] HTTP exception thrown: Volume tempest-invalid-988827418 could not be found. Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-138bcfd9-e722-4b65-9850-5f817a0e6b71 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] Request method failure captured: Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-988827418 HTTP/1.1 Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_Jgyv0hCbGYXGP06FWtTXkpJnpk7PJzjdQlB7KkhZYc7PiR5wgy3HHSh9lU122Gy_JWRpl7_4rGgkLrzw9yk-OBfoZgpPhnZQdgVvCVCsC_2mjO1-QGslJrXGOTuKmt9UKH2Eh70CMcsKCKZX2BLLTAA1fqn097CeDr1KS5RSBcVMlI Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 9a03094fc4d642eba293cbb9b8441165 Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-VolumesNegativeTest-269026327 Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:26:44.453361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:26:44.454998 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9a03094fc4d642eba293cbb9b8441165"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9a03094fc4d642eba293cbb9b8441165"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9a03094fc4d642eba293cbb9b8441165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9a03094fc4d642eba293cbb9b8441165"}]}] Aug 17 07:26:44.454998 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-VolumesNegativeTest-269026327 Aug 17 07:26:44.454998 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 9a03094fc4d642eba293cbb9b8441165 Aug 17 07:26:44.454998 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-VolumesNegativeTest-269026327 Aug 17 07:26:44.454998 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-VolumesNegativeTest-269026327-project Aug 17 07:26:44.454998 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:26:44.454998 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:26:44.454998 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: 65a8f63cfd304811a4feb48ea9776ec0 Aug 17 07:26:44.454998 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-VolumesNegativeTest-269026327-project Aug 17 07:26:44.454998 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: Aug 17 07:26:44.454998 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Volume tempest-invalid-988827418 could not be found. Aug 17 07:26:44.454998 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': 'tempest-invalid-988827418'} Aug 17 07:26:44.454998 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-988827418 could not be found. (HTTP 404) (Request-ID: req-38013984-20f7-417a-b069-c6a962ec0c10) Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:44.456090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 07:26:44.457663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-988827418 could not be found. Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:26:44.459125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-988827418 could not be found. Aug 17 07:26:44.460698 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.460698 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:44.460698 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.460698 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:44.460698 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:44.460698 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:44.460698 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:26:44.460698 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:26:44.460698 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-988827418 could not be found. Aug 17 07:26:44.460698 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.460698 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-138bcfd9-e722-4b65-9850-5f817a0e6b71 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] Returning 404 to user: Volume tempest-invalid-988827418 could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:26:44.460698 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-138bcfd9-e722-4b65-9850-5f817a0e6b71 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-988827418" status: 404 len: 98 microversion: 2.1 time: 0.553481 Aug 17 07:26:44.460698 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 4/4] 10.222.0.45 () {58 vars in 1215 bytes} [Wed Aug 17 07:26:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-988827418 => generated 98 bytes in 555 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 17 07:26:44.477581 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-f39fe487-e5fe-497d-9d4e-3927f50e4937 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014616 Aug 17 07:26:44.485312 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 5/5] 10.222.0.45 () {58 vars in 1140 bytes} [Wed Aug 17 07:26:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 17 07:26:44.509845 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-3fec4961-433a-4243-876c-63eaf5e873ba tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.016311 Aug 17 07:26:44.517000 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 6/6] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Aug 17 07:26:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 17 07:26:44.529325 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2a1564f8-cae5-4c48-bdb0-6cb750b91b48 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] Calling method '.version_select at 0x7f30ae140280>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:44.591601 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-2a1564f8-cae5-4c48-bdb0-6cb750b91b48 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] HTTP exception thrown: Volume e064874d-d88c-4501-ae38-2377867d3a2e could not be found. Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2a1564f8-cae5-4c48-bdb0-6cb750b91b48 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] Request method failure captured: Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: DELETE /compute/v2.1/os-volumes/e064874d-d88c-4501-ae38-2377867d3a2e HTTP/1.1 Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_Jgyv0hCbGYXGP06FWtTXkpJnpk7PJzjdQlB7KkhZYc7PiR5wgy3HHSh9lU122Gy_JWRpl7_4rGgkLrzw9yk-OBfoZgpPhnZQdgVvCVCsC_2mjO1-QGslJrXGOTuKmt9UKH2Eh70CMcsKCKZX2BLLTAA1fqn097CeDr1KS5RSBcVMlI Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 9a03094fc4d642eba293cbb9b8441165 Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-VolumesNegativeTest-269026327 Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:26:44.594394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:26:44.596559 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9a03094fc4d642eba293cbb9b8441165"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9a03094fc4d642eba293cbb9b8441165"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9a03094fc4d642eba293cbb9b8441165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9a03094fc4d642eba293cbb9b8441165"}]}] Aug 17 07:26:44.596559 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-VolumesNegativeTest-269026327 Aug 17 07:26:44.596559 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 9a03094fc4d642eba293cbb9b8441165 Aug 17 07:26:44.596559 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-VolumesNegativeTest-269026327 Aug 17 07:26:44.596559 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-VolumesNegativeTest-269026327-project Aug 17 07:26:44.596559 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:26:44.596559 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:26:44.596559 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: 65a8f63cfd304811a4feb48ea9776ec0 Aug 17 07:26:44.596559 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-VolumesNegativeTest-269026327-project Aug 17 07:26:44.596559 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: Aug 17 07:26:44.596559 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Volume e064874d-d88c-4501-ae38-2377867d3a2e could not be found. Aug 17 07:26:44.596559 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': 'e064874d-d88c-4501-ae38-2377867d3a2e'} Aug 17 07:26:44.596559 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e064874d-d88c-4501-ae38-2377867d3a2e could not be found. (HTTP 404) (Request-ID: req-3ec1b07a-148e-47a0-b69b-0336fd3db1c4) Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:44.597842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 07:26:44.605106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e064874d-d88c-4501-ae38-2377867d3a2e could not be found. Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 07:26:44.606263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:26:44.608140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e064874d-d88c-4501-ae38-2377867d3a2e could not be found. Aug 17 07:26:44.608140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.608140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:44.608140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.608140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:44.608140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:44.608140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:44.608140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:26:44.608140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:26:44.608140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e064874d-d88c-4501-ae38-2377867d3a2e could not be found. Aug 17 07:26:44.608140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.608140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2a1564f8-cae5-4c48-bdb0-6cb750b91b48 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] Returning 404 to user: Volume e064874d-d88c-4501-ae38-2377867d3a2e could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:26:44.608140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-2a1564f8-cae5-4c48-bdb0-6cb750b91b48 tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/e064874d-d88c-4501-ae38-2377867d3a2e" status: 404 len: 109 microversion: 2.1 time: 0.078823 Aug 17 07:26:44.608140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 7/7] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 17 07:26:44 2022] DELETE /compute/v2.1/os-volumes/e064874d-d88c-4501-ae38-2377867d3a2e => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:26:44.611543 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-0be585dc-9188-44fd-9b2e-b04fcc21878f tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] Calling method '.version_select at 0x7f30ae195b80>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:44.682247 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-0be585dc-9188-44fd-9b2e-b04fcc21878f tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] HTTP exception thrown: Volume c624a917-7408-4044-8fc5-fc61d8e02144 could not be found. Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-0be585dc-9188-44fd-9b2e-b04fcc21878f tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] Request method failure captured: Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/os-volumes/c624a917-7408-4044-8fc5-fc61d8e02144 HTTP/1.1 Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_Jgyv0hCbGYXGP06FWtTXkpJnpk7PJzjdQlB7KkhZYc7PiR5wgy3HHSh9lU122Gy_JWRpl7_4rGgkLrzw9yk-OBfoZgpPhnZQdgVvCVCsC_2mjO1-QGslJrXGOTuKmt9UKH2Eh70CMcsKCKZX2BLLTAA1fqn097CeDr1KS5RSBcVMlI Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 9a03094fc4d642eba293cbb9b8441165 Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-VolumesNegativeTest-269026327 Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:26:44.685289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:26:44.698219 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9a03094fc4d642eba293cbb9b8441165"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9a03094fc4d642eba293cbb9b8441165"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9a03094fc4d642eba293cbb9b8441165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9a03094fc4d642eba293cbb9b8441165"}]}] Aug 17 07:26:44.698219 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-VolumesNegativeTest-269026327 Aug 17 07:26:44.698219 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 9a03094fc4d642eba293cbb9b8441165 Aug 17 07:26:44.698219 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-VolumesNegativeTest-269026327 Aug 17 07:26:44.698219 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-VolumesNegativeTest-269026327-project Aug 17 07:26:44.698219 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:26:44.698219 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:26:44.698219 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: 65a8f63cfd304811a4feb48ea9776ec0 Aug 17 07:26:44.698219 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-VolumesNegativeTest-269026327-project Aug 17 07:26:44.698219 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: Aug 17 07:26:44.698219 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Volume c624a917-7408-4044-8fc5-fc61d8e02144 could not be found. Aug 17 07:26:44.698219 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': 'c624a917-7408-4044-8fc5-fc61d8e02144'} Aug 17 07:26:44.698219 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c624a917-7408-4044-8fc5-fc61d8e02144 could not be found. (HTTP 404) (Request-ID: req-77fd0322-6744-41c5-9f52-2e5595a6566e) Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:44.699752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 07:26:44.701003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c624a917-7408-4044-8fc5-fc61d8e02144 could not be found. Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 07:26:44.703210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:26:44.705752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c624a917-7408-4044-8fc5-fc61d8e02144 could not be found. Aug 17 07:26:44.705752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.705752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:44.705752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.705752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:44.705752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:44.705752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:44.705752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:26:44.705752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:26:44.705752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c624a917-7408-4044-8fc5-fc61d8e02144 could not be found. Aug 17 07:26:44.705752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:44.705752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-0be585dc-9188-44fd-9b2e-b04fcc21878f tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] Returning 404 to user: Volume c624a917-7408-4044-8fc5-fc61d8e02144 could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:26:44.705752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-0be585dc-9188-44fd-9b2e-b04fcc21878f tempest-VolumesNegativeTest-269026327 tempest-VolumesNegativeTest-269026327-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/c624a917-7408-4044-8fc5-fc61d8e02144" status: 404 len: 109 microversion: 2.1 time: 0.081464 Aug 17 07:26:44.705752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 8/8] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:26:44 2022] GET /compute/v2.1/os-volumes/c624a917-7408-4044-8fc5-fc61d8e02144 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:26:44.915625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-da2bf5c0-48d7-4114-b7b8-cdd25759fe57 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.698651 Aug 17 07:26:44.916177 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 1/9] 10.222.0.45 () {60 vars in 1155 bytes} [Wed Aug 17 07:26:42 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2701 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 17 07:26:44.933501 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-1ae9ff59-3469-4c31-a935-6909bd007c49 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Calling method '.version_select at 0x7f30ae2619d0>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:45.042263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-1ae9ff59-3469-4c31-a935-6909bd007c49 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7" status: 200 len: 345 microversion: 2.1 time: 0.115561 Aug 17 07:26:45.042822 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 9/10] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:26:44 2022] GET /compute/v2.1/os-volumes/bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 => generated 345 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:26:45.650039 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-269a5787-00be-459e-9195-ad403c343e39 tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] Calling method '.version_select at 0x7f30ae1b91f0>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:45.732152 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-269a5787-00be-459e-9195-ad403c343e39 tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/e7b9541d-d175-4a7f-ad15-a270e3e6e0de" status: 200 len: 351 microversion: 2.1 time: 0.088047 Aug 17 07:26:45.732775 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 2/11] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:26:45 2022] GET /compute/v2.1/os-volumes/e7b9541d-d175-4a7f-ad15-a270e3e6e0de => generated 351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:26:46.056437 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-763185b9-cfb8-4f80-b917-010c3562d1fa tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Calling method '.version_select at 0x7f30ae140670>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:46.177713 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-763185b9-cfb8-4f80-b917-010c3562d1fa tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7" status: 200 len: 346 microversion: 2.1 time: 0.125305 Aug 17 07:26:46.179386 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 10/12] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:26:46 2022] GET /compute/v2.1/os-volumes/bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 => generated 346 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:26:46.193508 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-45461d5b-b2a5-4dd3-ad9b-3aee53d93539 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Action: 'create', calling method: .version_select at 0x7f30ae1b98b0>, body: {"snapshot": {"volume_id": "bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-459784098"}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:26:46.787399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-45461d5b-b2a5-4dd3-ad9b-3aee53d93539 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.598409 Aug 17 07:26:46.803797 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b7c6df08-be3b-4d37-9049-505fe645a10d tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Calling method '.version_select at 0x7f30ae1405e0>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:46.809443 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 3/13] 10.222.0.45 () {60 vars in 1162 bytes} [Wed Aug 17 07:26:46 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:26:46.932305 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b7c6df08-be3b-4d37-9049-505fe645a10d tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/505d97c2-9f2c-43ed-be59-c5cfdb0d0e89" status: 200 len: 286 microversion: 2.1 time: 0.133238 Aug 17 07:26:46.933776 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 11/14] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 17 07:26:46 2022] GET /compute/v2.1/os-snapshots/505d97c2-9f2c-43ed-be59-c5cfdb0d0e89 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:26:46.945328 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-e5b0df4e-d23b-4ef5-b5f8-1490774960d2 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Calling method '.version_select at 0x7f30ae1c0940>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:47.008288 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-e5b0df4e-d23b-4ef5-b5f8-1490774960d2 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.067369 Aug 17 07:26:47.009318 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 4/15] 10.222.0.45 () {58 vars in 1140 bytes} [Wed Aug 17 07:26:46 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:26:47.023403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-58383a14-9261-485b-87b7-dea2626ea154 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Calling method '.version_select at 0x7f30ae140f70>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:47.086432 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-58383a14-9261-485b-87b7-dea2626ea154 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/505d97c2-9f2c-43ed-be59-c5cfdb0d0e89" status: 200 len: 286 microversion: 2.1 time: 0.068774 Aug 17 07:26:47.093661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 12/16] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 17 07:26:47 2022] GET /compute/v2.1/os-snapshots/505d97c2-9f2c-43ed-be59-c5cfdb0d0e89 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:26:47.444204 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-321a6a3f-58a3-4f41-a007-a3e5ceaed10f tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] Calling method '.version_select at 0x7f30ae1b9310>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:47.529496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-321a6a3f-58a3-4f41-a007-a3e5ceaed10f tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/b8910e4c-4311-4bfa-a75c-195b8c7685a2" status: 200 len: 351 microversion: 2.1 time: 0.089088 Aug 17 07:26:47.530647 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 5/17] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:26:47 2022] GET /compute/v2.1/os-volumes/b8910e4c-4311-4bfa-a75c-195b8c7685a2 => generated 351 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:26:48.107661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-79ea4556-3a04-400a-88f1-6d7b93da0e8d tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Calling method '.version_select at 0x7f30ae195a60>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:48.159358 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-79ea4556-3a04-400a-88f1-6d7b93da0e8d tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/505d97c2-9f2c-43ed-be59-c5cfdb0d0e89" status: 200 len: 286 microversion: 2.1 time: 0.060078 Aug 17 07:26:48.165103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 13/18] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 17 07:26:48 2022] GET /compute/v2.1/os-snapshots/505d97c2-9f2c-43ed-be59-c5cfdb0d0e89 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:26:49.172221 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-de13a7fb-efee-4732-9f3a-c92f98eed25a tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Calling method '.version_select at 0x7f30ae1c0700>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:49.240233 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-de13a7fb-efee-4732-9f3a-c92f98eed25a tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/505d97c2-9f2c-43ed-be59-c5cfdb0d0e89" status: 200 len: 286 microversion: 2.1 time: 0.071339 Aug 17 07:26:49.242091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 6/19] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 17 07:26:49 2022] GET /compute/v2.1/os-snapshots/505d97c2-9f2c-43ed-be59-c5cfdb0d0e89 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:26:50.253866 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-efa892cf-36aa-4c3c-ad58-e1b16d53e9d5 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Calling method '.version_select at 0x7f30ae140d30>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:50.324549 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-efa892cf-36aa-4c3c-ad58-e1b16d53e9d5 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/505d97c2-9f2c-43ed-be59-c5cfdb0d0e89" status: 200 len: 287 microversion: 2.1 time: 0.075164 Aug 17 07:26:50.325550 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 14/20] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 17 07:26:50 2022] GET /compute/v2.1/os-snapshots/505d97c2-9f2c-43ed-be59-c5cfdb0d0e89 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:26:50.337751 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c53b3496-3aaa-43eb-b487-cb0dd4024992 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Calling method '.version_select at 0x7f30ae1c0ee0>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:50.734546 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ac97778e-79a6-4968-af9a-034ea7e9e3c4 tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] Calling method '.version_select at 0x7f30ae1401f0>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:50.891193 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c53b3496-3aaa-43eb-b487-cb0dd4024992 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/505d97c2-9f2c-43ed-be59-c5cfdb0d0e89" status: 202 len: 0 microversion: 2.1 time: 0.558684 Aug 17 07:26:50.891649 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 7/21] 10.222.0.45 () {58 vars in 1254 bytes} [Wed Aug 17 07:26:50 2022] DELETE /compute/v2.1/os-snapshots/505d97c2-9f2c-43ed-be59-c5cfdb0d0e89 => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:26:50.894239 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-ac97778e-79a6-4968-af9a-034ea7e9e3c4 tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/e8595ad0-7eaf-4fed-9670-2d0cae08992d" status: 200 len: 351 microversion: 2.1 time: 0.164636 Aug 17 07:26:50.896735 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 15/22] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:26:50 2022] GET /compute/v2.1/os-volumes/e8595ad0-7eaf-4fed-9670-2d0cae08992d => generated 351 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:26:50.900315 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a2d91ac3-2578-4582-88dc-8088ca635e73 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Calling method '.version_select at 0x7f30ae1c0430>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:50.909370 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-31fb1049-b5b5-4086-a66e-7cd6887ea240 tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] Calling method '.version_select at 0x7f30ae2610d0>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:51.027203 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a2d91ac3-2578-4582-88dc-8088ca635e73 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/505d97c2-9f2c-43ed-be59-c5cfdb0d0e89" status: 200 len: 286 microversion: 2.1 time: 0.130795 Aug 17 07:26:51.028021 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 8/23] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 17 07:26:50 2022] GET /compute/v2.1/os-snapshots/505d97c2-9f2c-43ed-be59-c5cfdb0d0e89 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:26:51.143399 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-31fb1049-b5b5-4086-a66e-7cd6887ea240 tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.237097 Aug 17 07:26:51.155768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 16/24] 10.222.0.45 () {58 vars in 1134 bytes} [Wed Aug 17 07:26:50 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:26:51.162893 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f90ec665-5391-43ae-9bad-b0effc75db9a tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] Calling method '.version_select at 0x7f30ae1b95e0>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:51.403532 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f90ec665-5391-43ae-9bad-b0effc75db9a tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.246913 Aug 17 07:26:51.404882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 9/25] 10.222.0.45 () {58 vars in 1149 bytes} [Wed Aug 17 07:26:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:26:51.424922 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2e917543-6008-4670-95b6-84da502dda30 tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] Calling method '.version_select at 0x7f30ae140040>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:51.613850 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-2e917543-6008-4670-95b6-84da502dda30 tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.197198 Aug 17 07:26:51.614575 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 17/26] 10.222.0.45 () {58 vars in 1134 bytes} [Wed Aug 17 07:26:51 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:26:51.632262 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-662b3e16-4459-4a68-8c06-6f1e1705db12 tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] Calling method '.version_select at 0x7f30ae1cd700>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:51.865801 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-662b3e16-4459-4a68-8c06-6f1e1705db12 tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.241811 Aug 17 07:26:51.868220 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 10/27] 10.222.0.45 () {58 vars in 1167 bytes} [Wed Aug 17 07:26:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:26:51.881547 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-75f3e21b-d488-402b-867b-c4fe4169352d tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] Calling method '.version_select at 0x7f30ae146790>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:52.039949 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0b0e07d4-dc46-4fe9-aeff-3e1f333fee42 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Calling method '.version_select at 0x7f30ae1cdb80>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:52.092312 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-0b0e07d4-dc46-4fe9-aeff-3e1f333fee42 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] HTTP exception thrown: Snapshot 505d97c2-9f2c-43ed-be59-c5cfdb0d0e89 could not be found. Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0b0e07d4-dc46-4fe9-aeff-3e1f333fee42 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Request method failure captured: Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: GET /compute/v2.1/os-snapshots/505d97c2-9f2c-43ed-be59-c5cfdb0d0e89 HTTP/1.1 Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JgyEb5moySFk-20kxWqIcVTudldaKUkO7GD7BL6fW772hv66_MD9ohmShcIjLPcGQJAbmauLWwBVAwRn8mD7E8RsXzL0dLBzkTGELcPAyYG9dx5ErcTsFoRkAv41FvzfRlApYMwJk24IQCBhhu_aqtsicJ2s2CbZt1y31jUDvGMdO4 Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 1b2e5d9fbec04a3e93755db28188b79e Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-412739305 Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:26:52.097035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:26:52.098337 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1b2e5d9fbec04a3e93755db28188b79e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1b2e5d9fbec04a3e93755db28188b79e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b2e5d9fbec04a3e93755db28188b79e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b2e5d9fbec04a3e93755db28188b79e"}]}] Aug 17 07:26:52.098337 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-VolumesSnapshotsTestJSON-412739305 Aug 17 07:26:52.098337 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 1b2e5d9fbec04a3e93755db28188b79e Aug 17 07:26:52.098337 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-412739305 Aug 17 07:26:52.098337 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-VolumesSnapshotsTestJSON-412739305-project Aug 17 07:26:52.098337 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:26:52.098337 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:26:52.098337 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: 89228d4b67e44fca9dffab4f2b85a32e Aug 17 07:26:52.098337 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-VolumesSnapshotsTestJSON-412739305-project Aug 17 07:26:52.098337 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: Aug 17 07:26:52.098337 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Snapshot 505d97c2-9f2c-43ed-be59-c5cfdb0d0e89 could not be found. Aug 17 07:26:52.098337 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': '505d97c2-9f2c-43ed-be59-c5cfdb0d0e89'} Aug 17 07:26:52.098337 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:26:52.099061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:52.099061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 17 07:26:52.099061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 17 07:26:52.099061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 17 07:26:52.099061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 17 07:26:52.099061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 17 07:26:52.099061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 17 07:26:52.099061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 07:26:52.099061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 07:26:52.099061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 07:26:52.099061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 07:26:52.099061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 07:26:52.099061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 07:26:52.099061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 07:26:52.099061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 07:26:52.099061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 505d97c2-9f2c-43ed-be59-c5cfdb0d0e89 could not be found. (HTTP 404) (Request-ID: req-09a9f0f2-2e24-459b-8a1d-47abc0e68a17) Aug 17 07:26:52.099061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:26:52.099061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 07:26:52.100365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 505d97c2-9f2c-43ed-be59-c5cfdb0d0e89 could not be found. Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 17 07:26:52.101330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:26:52.102375 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 505d97c2-9f2c-43ed-be59-c5cfdb0d0e89 could not be found. Aug 17 07:26:52.102375 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:26:52.102375 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:52.102375 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:26:52.102375 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:52.102375 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:52.102375 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:52.102375 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:26:52.102375 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:26:52.102375 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 505d97c2-9f2c-43ed-be59-c5cfdb0d0e89 could not be found. Aug 17 07:26:52.102375 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:26:52.105000 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0b0e07d4-dc46-4fe9-aeff-3e1f333fee42 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Returning 404 to user: Snapshot 505d97c2-9f2c-43ed-be59-c5cfdb0d0e89 could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:26:52.106162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0b0e07d4-dc46-4fe9-aeff-3e1f333fee42 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/505d97c2-9f2c-43ed-be59-c5cfdb0d0e89" status: 404 len: 111 microversion: 2.1 time: 0.069970 Aug 17 07:26:52.111254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 11/28] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 17 07:26:52 2022] GET /compute/v2.1/os-snapshots/505d97c2-9f2c-43ed-be59-c5cfdb0d0e89 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:26:52.130404 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1bc862e5-b68d-498f-b3f0-2de0be2f7eb7 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Calling method '.version_select at 0x7f30ae1cd8b0>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:52.169513 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-75f3e21b-d488-402b-867b-c4fe4169352d tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.291707 Aug 17 07:26:52.180355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 18/29] 10.222.0.45 () {58 vars in 1170 bytes} [Wed Aug 17 07:26:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:26:52.185446 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-114f1023-8877-4d7d-904a-fafa2f0c3431 tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] Calling method '.version_select at 0x7f30ae1559d0>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:52.364302 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-1bc862e5-b68d-498f-b3f0-2de0be2f7eb7 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7" status: 202 len: 0 microversion: 2.1 time: 0.251672 Aug 17 07:26:52.369047 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 12/30] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 17 07:26:52 2022] DELETE /compute/v2.1/os-volumes/bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:26:52.380588 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-5d5e4ab9-0c0f-415b-9696-e7018ea009b1 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Calling method '.version_select at 0x7f30ae219f70>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:52.495032 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-114f1023-8877-4d7d-904a-fafa2f0c3431 tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.313401 Aug 17 07:26:52.496156 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 19/31] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Aug 17 07:26:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:26:52.512154 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b7882ed8-34db-4f38-924d-c204c28569b9 tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] Calling method '.version_select at 0x7f30ae155790>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:52.561917 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-5d5e4ab9-0c0f-415b-9696-e7018ea009b1 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7" status: 200 len: 345 microversion: 2.1 time: 0.191483 Aug 17 07:26:52.562781 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 13/32] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:26:52 2022] GET /compute/v2.1/os-volumes/bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 => generated 345 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:26:52.709452 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b7882ed8-34db-4f38-924d-c204c28569b9 tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.203121 Aug 17 07:26:52.710036 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 20/33] 10.222.0.45 () {58 vars in 1188 bytes} [Wed Aug 17 07:26:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:26:52.736428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0fe2e6ad-502a-4707-b67b-169982e86280 tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] Calling method '.version_select at 0x7f30ae358310>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:52.916883 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0fe2e6ad-502a-4707-b67b-169982e86280 tempest-VolumesTestJSON-1184662916 tempest-VolumesTestJSON-1184662916-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.195231 Aug 17 07:26:52.917537 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 14/34] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Aug 17 07:26:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:26:53.579463 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-314a1410-0ed4-4e1f-a88a-97bfbaef9406 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Calling method '.version_select at 0x7f30ae146550>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:53.641990 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-314a1410-0ed4-4e1f-a88a-97bfbaef9406 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] HTTP exception thrown: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-314a1410-0ed4-4e1f-a88a-97bfbaef9406 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Request method failure captured: Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/os-volumes/bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 HTTP/1.1 Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JgyEb5moySFk-20kxWqIcVTudldaKUkO7GD7BL6fW772hv66_MD9ohmShcIjLPcGQJAbmauLWwBVAwRn8mD7E8RsXzL0dLBzkTGELcPAyYG9dx5ErcTsFoRkAv41FvzfRlApYMwJk24IQCBhhu_aqtsicJ2s2CbZt1y31jUDvGMdO4 Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 1b2e5d9fbec04a3e93755db28188b79e Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-412739305 Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:26:53.644661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:26:53.645985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1b2e5d9fbec04a3e93755db28188b79e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1b2e5d9fbec04a3e93755db28188b79e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b2e5d9fbec04a3e93755db28188b79e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b2e5d9fbec04a3e93755db28188b79e"}]}] Aug 17 07:26:53.645985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-VolumesSnapshotsTestJSON-412739305 Aug 17 07:26:53.645985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 1b2e5d9fbec04a3e93755db28188b79e Aug 17 07:26:53.645985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-412739305 Aug 17 07:26:53.645985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-VolumesSnapshotsTestJSON-412739305-project Aug 17 07:26:53.645985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:26:53.645985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:26:53.645985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: 89228d4b67e44fca9dffab4f2b85a32e Aug 17 07:26:53.645985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-VolumesSnapshotsTestJSON-412739305-project Aug 17 07:26:53.645985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: Aug 17 07:26:53.645985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. Aug 17 07:26:53.645985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': 'bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7'} Aug 17 07:26:53.645985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. (HTTP 404) (Request-ID: req-985588e9-70c1-47e4-8f2a-738b13face32) Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:53.646829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 07:26:53.647944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 07:26:53.649150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:26:53.650284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. Aug 17 07:26:53.650284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.650284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:53.650284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.650284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:53.650284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:53.650284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:53.650284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:26:53.650284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:26:53.650284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. Aug 17 07:26:53.650284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.650284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-314a1410-0ed4-4e1f-a88a-97bfbaef9406 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Returning 404 to user: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:26:53.652842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-314a1410-0ed4-4e1f-a88a-97bfbaef9406 tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7" status: 404 len: 109 microversion: 2.1 time: 0.074613 Aug 17 07:26:53.653490 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 21/35] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:26:53 2022] GET /compute/v2.1/os-volumes/bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:26:53.676948 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7df34da5-05b1-4fd3-a7b8-166a734caf2a tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Calling method '.version_select at 0x7f30ae1c93a0>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:53.759020 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-7df34da5-05b1-4fd3-a7b8-166a734caf2a tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] HTTP exception thrown: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7df34da5-05b1-4fd3-a7b8-166a734caf2a tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Request method failure captured: Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: DELETE /compute/v2.1/os-volumes/bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 HTTP/1.1 Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JgyEb5moySFk-20kxWqIcVTudldaKUkO7GD7BL6fW772hv66_MD9ohmShcIjLPcGQJAbmauLWwBVAwRn8mD7E8RsXzL0dLBzkTGELcPAyYG9dx5ErcTsFoRkAv41FvzfRlApYMwJk24IQCBhhu_aqtsicJ2s2CbZt1y31jUDvGMdO4 Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 1b2e5d9fbec04a3e93755db28188b79e Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-412739305 Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:26:53.761625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:26:53.762787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1b2e5d9fbec04a3e93755db28188b79e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1b2e5d9fbec04a3e93755db28188b79e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b2e5d9fbec04a3e93755db28188b79e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b2e5d9fbec04a3e93755db28188b79e"}]}] Aug 17 07:26:53.762787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-VolumesSnapshotsTestJSON-412739305 Aug 17 07:26:53.762787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 1b2e5d9fbec04a3e93755db28188b79e Aug 17 07:26:53.762787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-412739305 Aug 17 07:26:53.762787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-VolumesSnapshotsTestJSON-412739305-project Aug 17 07:26:53.762787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:26:53.762787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:26:53.762787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: 89228d4b67e44fca9dffab4f2b85a32e Aug 17 07:26:53.762787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-VolumesSnapshotsTestJSON-412739305-project Aug 17 07:26:53.762787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: Aug 17 07:26:53.762787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. Aug 17 07:26:53.762787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': 'bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7'} Aug 17 07:26:53.762787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. (HTTP 404) (Request-ID: req-15153f11-ed2d-4e84-b023-feef8181a8d5) Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:53.763486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 07:26:53.764455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 07:26:53.765380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:26:53.768027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. Aug 17 07:26:53.768027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.768027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:53.768027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.768027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:53.768027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:53.768027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:53.768027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:26:53.768027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:26:53.768027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. Aug 17 07:26:53.768027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.768027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7df34da5-05b1-4fd3-a7b8-166a734caf2a tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Returning 404 to user: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:26:53.768027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-7df34da5-05b1-4fd3-a7b8-166a734caf2a tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7" status: 404 len: 109 microversion: 2.1 time: 0.099498 Aug 17 07:26:53.768027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 15/36] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 17 07:26:53 2022] DELETE /compute/v2.1/os-volumes/bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:26:53.774879 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ce105a12-5d35-48fb-af75-192fd519dcde tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Calling method '.version_select at 0x7f30ae146670>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:26:53.826194 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-ce105a12-5d35-48fb-af75-192fd519dcde tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] HTTP exception thrown: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ce105a12-5d35-48fb-af75-192fd519dcde tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Request method failure captured: Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/os-volumes/bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 HTTP/1.1 Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JgyEb5moySFk-20kxWqIcVTudldaKUkO7GD7BL6fW772hv66_MD9ohmShcIjLPcGQJAbmauLWwBVAwRn8mD7E8RsXzL0dLBzkTGELcPAyYG9dx5ErcTsFoRkAv41FvzfRlApYMwJk24IQCBhhu_aqtsicJ2s2CbZt1y31jUDvGMdO4 Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 1b2e5d9fbec04a3e93755db28188b79e Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-412739305 Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:26:53.828148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:26:53.829544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1b2e5d9fbec04a3e93755db28188b79e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1b2e5d9fbec04a3e93755db28188b79e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b2e5d9fbec04a3e93755db28188b79e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b2e5d9fbec04a3e93755db28188b79e"}]}] Aug 17 07:26:53.829544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-VolumesSnapshotsTestJSON-412739305 Aug 17 07:26:53.829544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 1b2e5d9fbec04a3e93755db28188b79e Aug 17 07:26:53.829544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-412739305 Aug 17 07:26:53.829544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-VolumesSnapshotsTestJSON-412739305-project Aug 17 07:26:53.829544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:26:53.829544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:26:53.829544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: 89228d4b67e44fca9dffab4f2b85a32e Aug 17 07:26:53.829544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-VolumesSnapshotsTestJSON-412739305-project Aug 17 07:26:53.829544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: Aug 17 07:26:53.829544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. Aug 17 07:26:53.829544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': 'bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7'} Aug 17 07:26:53.829544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. (HTTP 404) (Request-ID: req-6ee5c0ec-ae21-486e-a121-885d8daa2b6a) Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:53.830355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 07:26:53.831457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 07:26:53.835749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:26:53.836897 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. Aug 17 07:26:53.836897 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.836897 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:26:53.836897 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.836897 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:26:53.836897 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:26:53.836897 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:26:53.836897 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:26:53.836897 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:26:53.836897 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. Aug 17 07:26:53.836897 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:26:53.836897 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ce105a12-5d35-48fb-af75-192fd519dcde tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] Returning 404 to user: Volume bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:26:53.836897 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-ce105a12-5d35-48fb-af75-192fd519dcde tempest-VolumesSnapshotsTestJSON-412739305 tempest-VolumesSnapshotsTestJSON-412739305-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7" status: 404 len: 109 microversion: 2.1 time: 0.060609 Aug 17 07:26:53.836897 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 22/37] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:26:53 2022] GET /compute/v2.1/os-volumes/bdbe6be9-66f3-4e67-bf3b-d8d2f7845bc7 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:26:55.690995 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-11ed0874-18da-4826-a80e-b8fb0c281b09 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Action: 'create', calling method: .version_select at 0x7f30ae1c0e50>, body: {"keypair": {"name": "tempest-keypair-1441581561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3vAES/6H1EfmuBmUt6DztvNnkmToh7AXVq6NpxTT9l/u/4nTOJL9fqJsvr12F9BbbiI/WosHNxUaJ5oreOkuw9Ti9vzK1YX9WZq00qIGfcbAGQhMunRqHUFlQoWvCu8A=="}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:26:55.756832 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-11ed0874-18da-4826-a80e-b8fb0c281b09 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Getting quotas for project 58fb14530132434d959da285830fa9b6. Resources: {'key_pairs'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:26:55.769665 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-11ed0874-18da-4826-a80e-b8fb0c281b09 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Getting quotas for user 21e14b8bcd4442168c2d1b7cfc956dce and project 58fb14530132434d959da285830fa9b6. Resources: {'key_pairs'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:26:55.873132 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-11ed0874-18da-4826-a80e-b8fb0c281b09 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.351672 Aug 17 07:26:55.874817 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 16/38] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Aug 17 07:26:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 356 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 17 07:27:02.323926 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-4bcf31c6-c705-4de6-a472-02ee26eaf119 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-241306729", "imageRef": "37843ca7-b19a-44f1-acf3-e9432324d4b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:02.538024 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1a70445e-ac2a-4975-8282-6896350571cc tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Action: 'create', calling method: .version_select at 0x7f30ae219f70>, body: {"keypair": {"name": "tempest-keypair-2002418318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUZHNeT47xlmxFVasnj5tPxJNgEltL19AzAwsUJeBkAaKM03tiZKkrMSx9HWAhQX97VVTscI6+vd+zVHfnWaF7nzMmXItJdwOF2U07GIG9sqeIi89cZvcbY15uNq4RAEw=="}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:02.546384 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.network.neutron [None req-4bcf31c6-c705-4de6-a472-02ee26eaf119 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] validate_networks() for [('198cd0ce-2e6c-40dc-aae4-0071ce2ee0e2', None, None, None, None, None)] {{(pid=120835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:27:02.593066 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-1a70445e-ac2a-4975-8282-6896350571cc tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Getting quotas for project 3c491181ae054706be3bdc94c61501f9. Resources: {'key_pairs'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:27:02.602719 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-1a70445e-ac2a-4975-8282-6896350571cc tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Getting quotas for user c11d183b3c0c4b2b83f3b52b881a72cf and project 3c491181ae054706be3bdc94c61501f9. Resources: {'key_pairs'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:27:02.687501 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-1a70445e-ac2a-4975-8282-6896350571cc tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.303215 Aug 17 07:27:02.689097 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 17/39] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 17 07:27:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:27:03.108265 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-681466f3-2a95-4b8d-a00a-328acaf7695b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Action: 'create', calling method: .version_select at 0x7f30ad8b5790>, body: {"keypair": {"name": "tempest-keypair-99949283", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCAeNVLe09+DLtqYAzgFCXnLdqTTnm5k3tIzDAJKjeMBXu5wIMsZEr5ja6w5Km+LB35pKu/hSnkU6sqCUQjFXzWUwesCYwpuYP+GIGsGwrfmd98l1apWXKW4sUHA4WxkQ=="}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:03.184569 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-681466f3-2a95-4b8d-a00a-328acaf7695b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Getting quotas for project 99d9a3fa9369495ab6d8da88f3d9dbd5. Resources: {'key_pairs'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:27:03.208865 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-681466f3-2a95-4b8d-a00a-328acaf7695b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Getting quotas for user f8b0c96c80db4db4a477a1fa6c1fa4db and project 99d9a3fa9369495ab6d8da88f3d9dbd5. Resources: {'key_pairs'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:27:03.314891 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-681466f3-2a95-4b8d-a00a-328acaf7695b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.624469 Aug 17 07:27:03.341914 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 18/40] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 17 07:27:02 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:27:03.558289 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-020910be-cd7d-47d6-88c5-81cfa6299846 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-420237019", "imageRef": "37843ca7-b19a-44f1-acf3-e9432324d4b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "356b41b9-fa7f-45f5-8619-f5e71d8ddd74"}], "security_groups": [{"name": "tempest-securitygroup--1935264838"}], "key_name": "tempest-keypair-1441581561", "user_data": "}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:04.339794 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.network.neutron [None req-020910be-cd7d-47d6-88c5-81cfa6299846 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] validate_networks() for [('356b41b9-fa7f-45f5-8619-f5e71d8ddd74', None, None, None, None, None)] {{(pid=120834) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:27:04.897260 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-4bcf31c6-c705-4de6-a472-02ee26eaf119 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Flavor limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:27:04.898467 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-4bcf31c6-c705-4de6-a472-02ee26eaf119 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Image limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:27:04.899798 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-4bcf31c6-c705-4de6-a472-02ee26eaf119 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Flavor pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:27:04.900425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-4bcf31c6-c705-4de6-a472-02ee26eaf119 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Image pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:27:04.901195 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-4bcf31c6-c705-4de6-a472-02ee26eaf119 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:27:04.946800 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4bcf31c6-c705-4de6-a472-02ee26eaf119 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:04.948075 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4bcf31c6-c705-4de6-a472-02ee26eaf119 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:04.948714 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4bcf31c6-c705-4de6-a472-02ee26eaf119 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:04.949645 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4bcf31c6-c705-4de6-a472-02ee26eaf119 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:04.955033 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4bcf31c6-c705-4de6-a472-02ee26eaf119 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:04.955796 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4bcf31c6-c705-4de6-a472-02ee26eaf119 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:05.010055 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-4bcf31c6-c705-4de6-a472-02ee26eaf119 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Getting quotas for project 177d0707c9d1494abc77c714e31fa15f. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:27:05.019038 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-4bcf31c6-c705-4de6-a472-02ee26eaf119 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Getting quotas for user be489ecec19847829df7c4488986373e and project 177d0707c9d1494abc77c714e31fa15f. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:27:05.033794 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-4bcf31c6-c705-4de6-a472-02ee26eaf119 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Going to run 1 instances... {{(pid=120835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:27:05.037491 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-4bcf31c6-c705-4de6-a472-02ee26eaf119 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37843ca7-b19a-44f1-acf3-e9432324d4b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:27:05.160735 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-4bcf31c6-c705-4de6-a472-02ee26eaf119 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.085413 Aug 17 07:27:05.162139 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 23/41] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:27:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 3087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 07:27:05.817386 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-f206074d-025a-43e1-8bcd-3e46d3072271 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1408909046", "imageRef": "37843ca7-b19a-44f1-acf3-e9432324d4b2", "flavorRef": "452", "networks": [{"uuid": "9a807ad1-4fdf-4ef4-84d5-9f6a2b8f5028"}]}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:05.961356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.network.neutron [None req-f206074d-025a-43e1-8bcd-3e46d3072271 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] validate_networks() for [('9a807ad1-4fdf-4ef4-84d5-9f6a2b8f5028', None, None, None, None, None)] {{(pid=120835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:27:07.626640 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-020910be-cd7d-47d6-88c5-81cfa6299846 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Flavor limits 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:27:07.627323 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-020910be-cd7d-47d6-88c5-81cfa6299846 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Image limits 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:27:07.627581 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-020910be-cd7d-47d6-88c5-81cfa6299846 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Flavor pref 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:27:07.628007 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-020910be-cd7d-47d6-88c5-81cfa6299846 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Image pref 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:27:07.628405 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-020910be-cd7d-47d6-88c5-81cfa6299846 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:27:07.648762 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-020910be-cd7d-47d6-88c5-81cfa6299846 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:07.650524 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-020910be-cd7d-47d6-88c5-81cfa6299846 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:07.654437 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-020910be-cd7d-47d6-88c5-81cfa6299846 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:07.655485 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-020910be-cd7d-47d6-88c5-81cfa6299846 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:07.673010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-020910be-cd7d-47d6-88c5-81cfa6299846 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:07.674095 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-020910be-cd7d-47d6-88c5-81cfa6299846 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:07.763105 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-020910be-cd7d-47d6-88c5-81cfa6299846 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Getting quotas for project 58fb14530132434d959da285830fa9b6. Resources: {'ram', 'cores', 'instances'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:27:07.777404 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-020910be-cd7d-47d6-88c5-81cfa6299846 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Getting quotas for user 21e14b8bcd4442168c2d1b7cfc956dce and project 58fb14530132434d959da285830fa9b6. Resources: {'ram', 'cores', 'instances'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:27:07.819155 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-020910be-cd7d-47d6-88c5-81cfa6299846 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Going to run 1 instances... {{(pid=120834) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:27:07.821930 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-020910be-cd7d-47d6-88c5-81cfa6299846 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37843ca7-b19a-44f1-acf3-e9432324d4b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120834) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:27:08.068116 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-020910be-cd7d-47d6-88c5-81cfa6299846 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.519537 Aug 17 07:27:08.068766 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 19/42] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Aug 17 07:27:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 4521 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 17 07:27:08.077316 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7f24ab48-60e5-4ad1-830b-d248acfb551a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:08.077765 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-7f24ab48-60e5-4ad1-830b-d248acfb551a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:08.138968 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7f24ab48-60e5-4ad1-830b-d248acfb551a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:08.139462 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7f24ab48-60e5-4ad1-830b-d248acfb551a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:08.139907 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7f24ab48-60e5-4ad1-830b-d248acfb551a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:08.140625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7f24ab48-60e5-4ad1-830b-d248acfb551a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:08.141081 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7f24ab48-60e5-4ad1-830b-d248acfb551a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:08.141560 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7f24ab48-60e5-4ad1-830b-d248acfb551a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:08.332315 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-f206074d-025a-43e1-8bcd-3e46d3072271 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Flavor limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:27:08.332808 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-f206074d-025a-43e1-8bcd-3e46d3072271 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Image limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:27:08.333208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-f206074d-025a-43e1-8bcd-3e46d3072271 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Flavor pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:27:08.333620 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-f206074d-025a-43e1-8bcd-3e46d3072271 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Image pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:27:08.335562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-f206074d-025a-43e1-8bcd-3e46d3072271 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:27:08.349029 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f206074d-025a-43e1-8bcd-3e46d3072271 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:08.349519 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f206074d-025a-43e1-8bcd-3e46d3072271 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:08.349955 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f206074d-025a-43e1-8bcd-3e46d3072271 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:08.366950 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f206074d-025a-43e1-8bcd-3e46d3072271 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:08.367655 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f206074d-025a-43e1-8bcd-3e46d3072271 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:08.368250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f206074d-025a-43e1-8bcd-3e46d3072271 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:08.442987 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-f206074d-025a-43e1-8bcd-3e46d3072271 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Getting quotas for project 2c3f36e86c51479c9bbe844a650ca355. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:27:08.455354 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-f206074d-025a-43e1-8bcd-3e46d3072271 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Getting quotas for user ca68ccce2ae54eccbfb1afd171424746 and project 2c3f36e86c51479c9bbe844a650ca355. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:27:08.495021 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-f206074d-025a-43e1-8bcd-3e46d3072271 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Going to run 1 instances... {{(pid=120835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:27:08.497701 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-f206074d-025a-43e1-8bcd-3e46d3072271 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37843ca7-b19a-44f1-acf3-e9432324d4b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:27:08.631921 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-7f24ab48-60e5-4ad1-830b-d248acfb551a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:08.640191 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-f206074d-025a-43e1-8bcd-3e46d3072271 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.476722 Aug 17 07:27:08.642938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 24/43] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:27:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 07:27:08.657690 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-7f24ab48-60e5-4ad1-830b-d248acfb551a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1225 microversion: 2.1 time: 0.585619 Aug 17 07:27:08.658200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a7e84113-9226-4c84-ae28-5d00cf5938f3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:08.682153 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 20/44] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:08 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1225 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:08.688728 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a7e84113-9226-4c84-ae28-5d00cf5938f3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:08.695174 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1f44e6e8-cd0c-4644-b6bd-2b376b847084 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:08.696375 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-1f44e6e8-cd0c-4644-b6bd-2b376b847084 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:09.038061 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a7e84113-9226-4c84-ae28-5d00cf5938f3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:09.067079 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a7e84113-9226-4c84-ae28-5d00cf5938f3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:09.084894 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a7e84113-9226-4c84-ae28-5d00cf5938f3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:09.086510 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a7e84113-9226-4c84-ae28-5d00cf5938f3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1281 microversion: 2.20 time: 0.442465 Aug 17 07:27:09.092799 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 25/45] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:08 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1281 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:27:09.109773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-76458e04-22be-4b7e-870f-bc54bb49edf4 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1938783707", "imageRef": "37843ca7-b19a-44f1-acf3-e9432324d4b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:09.267436 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.network.neutron [None req-76458e04-22be-4b7e-870f-bc54bb49edf4 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] validate_networks() for [('198cd0ce-2e6c-40dc-aae4-0071ce2ee0e2', None, None, None, None, None)] {{(pid=120835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:27:09.544073 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-1f44e6e8-cd0c-4644-b6bd-2b376b847084 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:09.577240 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-1f44e6e8-cd0c-4644-b6bd-2b376b847084 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1215 microversion: 2.1 time: 0.891074 Aug 17 07:27:09.592034 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 21/46] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:08 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1215 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:10.112889 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c70dd5c8-abc8-4550-a296-143bd41304ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:10.113705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c70dd5c8-abc8-4550-a296-143bd41304ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:10.127611 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c70dd5c8-abc8-4550-a296-143bd41304ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:10.131332 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c70dd5c8-abc8-4550-a296-143bd41304ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:10.131923 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c70dd5c8-abc8-4550-a296-143bd41304ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:10.132869 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c70dd5c8-abc8-4550-a296-143bd41304ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:10.133436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c70dd5c8-abc8-4550-a296-143bd41304ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:10.135323 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c70dd5c8-abc8-4550-a296-143bd41304ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:10.285335 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c70dd5c8-abc8-4550-a296-143bd41304ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:10.304026 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c70dd5c8-abc8-4550-a296-143bd41304ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:10.311480 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c70dd5c8-abc8-4550-a296-143bd41304ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:10.312743 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c70dd5c8-abc8-4550-a296-143bd41304ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1277 microversion: 2.20 time: 0.207269 Aug 17 07:27:10.313333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 22/47] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:10 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1277 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:27:10.599785 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-78923b31-2314-4539-aaf4-b22b9f296811 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:10.600396 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-78923b31-2314-4539-aaf4-b22b9f296811 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:10.615161 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-78923b31-2314-4539-aaf4-b22b9f296811 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:10.618290 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-78923b31-2314-4539-aaf4-b22b9f296811 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:10.619555 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-78923b31-2314-4539-aaf4-b22b9f296811 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:10.622881 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-78923b31-2314-4539-aaf4-b22b9f296811 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:10.626747 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-78923b31-2314-4539-aaf4-b22b9f296811 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:10.629671 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-78923b31-2314-4539-aaf4-b22b9f296811 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:10.978779 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-78923b31-2314-4539-aaf4-b22b9f296811 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:10.986858 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-78923b31-2314-4539-aaf4-b22b9f296811 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1267 microversion: 2.1 time: 0.390842 Aug 17 07:27:10.987450 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 23/48] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:10 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1267 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:11.335552 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-dc71d96a-2abc-4d9c-872b-b910db5c2bab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:11.336845 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-dc71d96a-2abc-4d9c-872b-b910db5c2bab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:11.347289 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dc71d96a-2abc-4d9c-872b-b910db5c2bab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:11.348249 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dc71d96a-2abc-4d9c-872b-b910db5c2bab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:11.349558 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dc71d96a-2abc-4d9c-872b-b910db5c2bab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:11.351220 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dc71d96a-2abc-4d9c-872b-b910db5c2bab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:11.354497 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dc71d96a-2abc-4d9c-872b-b910db5c2bab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:11.355265 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dc71d96a-2abc-4d9c-872b-b910db5c2bab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:11.424764 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-76458e04-22be-4b7e-870f-bc54bb49edf4 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Flavor limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:27:11.425283 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-76458e04-22be-4b7e-870f-bc54bb49edf4 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Image limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:27:11.425857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-76458e04-22be-4b7e-870f-bc54bb49edf4 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Flavor pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:27:11.426406 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-76458e04-22be-4b7e-870f-bc54bb49edf4 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Image pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:27:11.426923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-76458e04-22be-4b7e-870f-bc54bb49edf4 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:27:11.449410 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-76458e04-22be-4b7e-870f-bc54bb49edf4 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:11.452235 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-76458e04-22be-4b7e-870f-bc54bb49edf4 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:11.454834 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-76458e04-22be-4b7e-870f-bc54bb49edf4 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:11.456742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-76458e04-22be-4b7e-870f-bc54bb49edf4 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:11.457373 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-76458e04-22be-4b7e-870f-bc54bb49edf4 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:11.460171 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-76458e04-22be-4b7e-870f-bc54bb49edf4 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:11.512076 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-76458e04-22be-4b7e-870f-bc54bb49edf4 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Getting quotas for project 177d0707c9d1494abc77c714e31fa15f. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:27:11.521696 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-76458e04-22be-4b7e-870f-bc54bb49edf4 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Getting quotas for user be489ecec19847829df7c4488986373e and project 177d0707c9d1494abc77c714e31fa15f. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:27:11.560847 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-76458e04-22be-4b7e-870f-bc54bb49edf4 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Going to run 1 instances... {{(pid=120835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:27:11.565988 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-76458e04-22be-4b7e-870f-bc54bb49edf4 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37843ca7-b19a-44f1-acf3-e9432324d4b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:27:11.585064 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-dc71d96a-2abc-4d9c-872b-b910db5c2bab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:11.596114 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-dc71d96a-2abc-4d9c-872b-b910db5c2bab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:11.601412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-dc71d96a-2abc-4d9c-872b-b910db5c2bab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:11.603274 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-dc71d96a-2abc-4d9c-872b-b910db5c2bab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1339 microversion: 2.20 time: 0.270948 Aug 17 07:27:11.614907 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:11 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1339 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:27:11.807364 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-76458e04-22be-4b7e-870f-bc54bb49edf4 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.713299 Aug 17 07:27:11.821126 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f8d0ee61-d369-42dd-95ec-3ab903ff596a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:11.822092 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f8d0ee61-d369-42dd-95ec-3ab903ff596a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:11.838417 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:27:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 2745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 07:27:12.010329 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-fce4a7de-d316-44ad-9621-a81ee25a95d5 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:12.011354 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-fce4a7de-d316-44ad-9621-a81ee25a95d5 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:12.031758 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fce4a7de-d316-44ad-9621-a81ee25a95d5 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:12.032404 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fce4a7de-d316-44ad-9621-a81ee25a95d5 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:12.049558 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fce4a7de-d316-44ad-9621-a81ee25a95d5 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:12.050267 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fce4a7de-d316-44ad-9621-a81ee25a95d5 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:12.053153 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fce4a7de-d316-44ad-9621-a81ee25a95d5 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:12.056321 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fce4a7de-d316-44ad-9621-a81ee25a95d5 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:12.838651 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f8d0ee61-d369-42dd-95ec-3ab903ff596a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:12.860615 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f8d0ee61-d369-42dd-95ec-3ab903ff596a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1222 microversion: 2.1 time: 1.038035 Aug 17 07:27:12.875275 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 25/51] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:11 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1222 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:12.911890 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9e07470a-c45b-43e4-8221-ea67f443b8fb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1060603315", "imageRef": "37843ca7-b19a-44f1-acf3-e9432324d4b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b93cc108-9c01-472b-9ec8-1ea1c98d8816"}], "security_groups": [{"name": "tempest-securitygroup--854147104"}], "key_name": "tempest-keypair-99949283", "user_data": "}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:13.027377 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-fce4a7de-d316-44ad-9621-a81ee25a95d5 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:13.055097 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-fce4a7de-d316-44ad-9621-a81ee25a95d5 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1273 microversion: 2.1 time: 1.049790 Aug 17 07:27:13.056383 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 27/52] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:12 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1273 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:27:13.067022 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2a16615b-958d-439f-9e90-db9d64eeadab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:13.067936 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-2a16615b-958d-439f-9e90-db9d64eeadab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:13.094858 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a16615b-958d-439f-9e90-db9d64eeadab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:13.095547 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a16615b-958d-439f-9e90-db9d64eeadab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:13.098264 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a16615b-958d-439f-9e90-db9d64eeadab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:13.099068 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a16615b-958d-439f-9e90-db9d64eeadab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:13.099543 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a16615b-958d-439f-9e90-db9d64eeadab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:13.107034 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a16615b-958d-439f-9e90-db9d64eeadab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:13.284385 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.network.neutron [None req-9e07470a-c45b-43e4-8221-ea67f443b8fb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] validate_networks() for [('b93cc108-9c01-472b-9ec8-1ea1c98d8816', None, None, None, None, None)] {{(pid=120834) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:27:13.372066 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2a16615b-958d-439f-9e90-db9d64eeadab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:13.397599 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2a16615b-958d-439f-9e90-db9d64eeadab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:13.401910 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2a16615b-958d-439f-9e90-db9d64eeadab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:13.406121 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-2a16615b-958d-439f-9e90-db9d64eeadab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1339 microversion: 2.20 time: 0.348358 Aug 17 07:27:13.410403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 28/53] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:13 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1339 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:27:13.887844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-5ce480bd-7840-4fb9-bcae-b49be6c8d548 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:13.888584 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-5ce480bd-7840-4fb9-bcae-b49be6c8d548 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:13.896811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5ce480bd-7840-4fb9-bcae-b49be6c8d548 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:13.897737 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5ce480bd-7840-4fb9-bcae-b49be6c8d548 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:13.898742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5ce480bd-7840-4fb9-bcae-b49be6c8d548 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:13.900046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5ce480bd-7840-4fb9-bcae-b49be6c8d548 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:13.900912 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5ce480bd-7840-4fb9-bcae-b49be6c8d548 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:13.901591 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5ce480bd-7840-4fb9-bcae-b49be6c8d548 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:14.328454 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-5ce480bd-7840-4fb9-bcae-b49be6c8d548 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:14.343268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-5ce480bd-7840-4fb9-bcae-b49be6c8d548 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1274 microversion: 2.1 time: 0.459452 Aug 17 07:27:14.353990 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 29/54] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:13 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1274 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:14.358945 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ec77f308-434d-432e-8f11-9203acf4a584 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:14.359577 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-ec77f308-434d-432e-8f11-9203acf4a584 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:14.373779 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ec77f308-434d-432e-8f11-9203acf4a584 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:14.374324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ec77f308-434d-432e-8f11-9203acf4a584 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:14.374767 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ec77f308-434d-432e-8f11-9203acf4a584 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:14.375490 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ec77f308-434d-432e-8f11-9203acf4a584 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:14.375985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ec77f308-434d-432e-8f11-9203acf4a584 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:14.376446 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ec77f308-434d-432e-8f11-9203acf4a584 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:14.623792 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ec77f308-434d-432e-8f11-9203acf4a584 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:14.632204 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-ec77f308-434d-432e-8f11-9203acf4a584 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1273 microversion: 2.1 time: 0.286329 Aug 17 07:27:14.646334 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 30/55] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:14 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1273 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:14.671876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-40dd0c7c-67b7-4778-bdd5-9cf20dd6fdf5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:14.671876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-40dd0c7c-67b7-4778-bdd5-9cf20dd6fdf5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:14.693739 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-40dd0c7c-67b7-4778-bdd5-9cf20dd6fdf5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:14.694272 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-40dd0c7c-67b7-4778-bdd5-9cf20dd6fdf5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:14.694715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-40dd0c7c-67b7-4778-bdd5-9cf20dd6fdf5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:14.695609 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-40dd0c7c-67b7-4778-bdd5-9cf20dd6fdf5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:14.696240 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-40dd0c7c-67b7-4778-bdd5-9cf20dd6fdf5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:14.696672 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-40dd0c7c-67b7-4778-bdd5-9cf20dd6fdf5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:14.991501 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-40dd0c7c-67b7-4778-bdd5-9cf20dd6fdf5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:15.001538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-40dd0c7c-67b7-4778-bdd5-9cf20dd6fdf5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:15.017763 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-40dd0c7c-67b7-4778-bdd5-9cf20dd6fdf5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:15.019760 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-40dd0c7c-67b7-4778-bdd5-9cf20dd6fdf5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1339 microversion: 2.20 time: 0.371577 Aug 17 07:27:15.019760 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 31/56] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:14 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1339 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:27:15.291352 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-1dd8ed27-1a31-4146-9f1c-371709e80124 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1461642290", "imageRef": "37843ca7-b19a-44f1-acf3-e9432324d4b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96c79c37-e502-4195-a9e7-9565916223c8"}], "security_groups": [{"name": "tempest-securitygroup--1138194309"}], "key_name": "tempest-keypair-2002418318", "user_data": "}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:15.616900 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.network.neutron [None req-1dd8ed27-1a31-4146-9f1c-371709e80124 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] validate_networks() for [('96c79c37-e502-4195-a9e7-9565916223c8', None, None, None, None, None)] {{(pid=120835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:27:16.064065 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-9e07470a-c45b-43e4-8221-ea67f443b8fb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Flavor limits 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:27:16.065081 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-9e07470a-c45b-43e4-8221-ea67f443b8fb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Image limits 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:27:16.065559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-9e07470a-c45b-43e4-8221-ea67f443b8fb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Flavor pref 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:27:16.065986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-9e07470a-c45b-43e4-8221-ea67f443b8fb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Image pref 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:27:16.066388 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-9e07470a-c45b-43e4-8221-ea67f443b8fb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:27:16.078296 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9e07470a-c45b-43e4-8221-ea67f443b8fb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:16.082924 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9e07470a-c45b-43e4-8221-ea67f443b8fb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:16.083368 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9e07470a-c45b-43e4-8221-ea67f443b8fb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:16.084498 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9e07470a-c45b-43e4-8221-ea67f443b8fb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:16.085156 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9e07470a-c45b-43e4-8221-ea67f443b8fb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:16.087012 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9e07470a-c45b-43e4-8221-ea67f443b8fb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:16.125920 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-9e07470a-c45b-43e4-8221-ea67f443b8fb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Getting quotas for project 99d9a3fa9369495ab6d8da88f3d9dbd5. Resources: {'ram', 'cores', 'instances'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:27:16.133654 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-9e07470a-c45b-43e4-8221-ea67f443b8fb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Getting quotas for user f8b0c96c80db4db4a477a1fa6c1fa4db and project 99d9a3fa9369495ab6d8da88f3d9dbd5. Resources: {'ram', 'cores', 'instances'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:27:16.147292 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9e07470a-c45b-43e4-8221-ea67f443b8fb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Going to run 1 instances... {{(pid=120834) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:27:16.149935 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9e07470a-c45b-43e4-8221-ea67f443b8fb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37843ca7-b19a-44f1-acf3-e9432324d4b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120834) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:27:16.222999 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9e07470a-c45b-43e4-8221-ea67f443b8fb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.343127 Aug 17 07:27:16.228778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 26/57] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:27:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 3353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 07:27:16.238854 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-6b7fae19-65ed-4b6e-8220-fb8ad7f49ed6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:16.239781 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-6b7fae19-65ed-4b6e-8220-fb8ad7f49ed6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:16.247693 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6b7fae19-65ed-4b6e-8220-fb8ad7f49ed6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:16.248401 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6b7fae19-65ed-4b6e-8220-fb8ad7f49ed6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:16.248997 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6b7fae19-65ed-4b6e-8220-fb8ad7f49ed6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:16.249845 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6b7fae19-65ed-4b6e-8220-fb8ad7f49ed6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:16.250781 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6b7fae19-65ed-4b6e-8220-fb8ad7f49ed6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:16.251409 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6b7fae19-65ed-4b6e-8220-fb8ad7f49ed6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:16.418129 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-6b7fae19-65ed-4b6e-8220-fb8ad7f49ed6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:16.431199 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-6b7fae19-65ed-4b6e-8220-fb8ad7f49ed6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1280 microversion: 2.1 time: 0.200983 Aug 17 07:27:16.433303 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 27/58] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:16 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1280 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:16.451665 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-d02c1a08-1a56-4b44-bfce-c5b01bb3be6f tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:16.452291 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-d02c1a08-1a56-4b44-bfce-c5b01bb3be6f tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:16.460444 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d02c1a08-1a56-4b44-bfce-c5b01bb3be6f tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:16.461372 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d02c1a08-1a56-4b44-bfce-c5b01bb3be6f tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:16.462174 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d02c1a08-1a56-4b44-bfce-c5b01bb3be6f tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:16.463487 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d02c1a08-1a56-4b44-bfce-c5b01bb3be6f tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:16.464476 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d02c1a08-1a56-4b44-bfce-c5b01bb3be6f tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:16.465045 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d02c1a08-1a56-4b44-bfce-c5b01bb3be6f tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:17.017921 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-d02c1a08-1a56-4b44-bfce-c5b01bb3be6f tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:17.045082 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-d02c1a08-1a56-4b44-bfce-c5b01bb3be6f tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1315 microversion: 2.1 time: 0.605319 Aug 17 07:27:17.048444 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 28/59] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:16 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:17.059985 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a2809950-e34e-4a7d-b393-edf97c2c8246 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:17.060600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-a2809950-e34e-4a7d-b393-edf97c2c8246 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:17.076117 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a2809950-e34e-4a7d-b393-edf97c2c8246 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:17.076782 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a2809950-e34e-4a7d-b393-edf97c2c8246 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:17.077904 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a2809950-e34e-4a7d-b393-edf97c2c8246 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:17.079066 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a2809950-e34e-4a7d-b393-edf97c2c8246 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:17.079529 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a2809950-e34e-4a7d-b393-edf97c2c8246 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:17.079954 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a2809950-e34e-4a7d-b393-edf97c2c8246 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:17.220984 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-1dd8ed27-1a31-4146-9f1c-371709e80124 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Flavor limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:27:17.221466 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-1dd8ed27-1a31-4146-9f1c-371709e80124 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Image limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:27:17.221859 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-1dd8ed27-1a31-4146-9f1c-371709e80124 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Flavor pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:27:17.222327 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-1dd8ed27-1a31-4146-9f1c-371709e80124 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Image pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:27:17.222939 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-1dd8ed27-1a31-4146-9f1c-371709e80124 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:27:17.248301 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1dd8ed27-1a31-4146-9f1c-371709e80124 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:17.248824 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1dd8ed27-1a31-4146-9f1c-371709e80124 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:17.251902 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1dd8ed27-1a31-4146-9f1c-371709e80124 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:17.255383 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1dd8ed27-1a31-4146-9f1c-371709e80124 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:17.256504 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1dd8ed27-1a31-4146-9f1c-371709e80124 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:17.257586 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1dd8ed27-1a31-4146-9f1c-371709e80124 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:17.311154 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-1dd8ed27-1a31-4146-9f1c-371709e80124 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Getting quotas for project 3c491181ae054706be3bdc94c61501f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:27:17.322498 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-1dd8ed27-1a31-4146-9f1c-371709e80124 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Getting quotas for user c11d183b3c0c4b2b83f3b52b881a72cf and project 3c491181ae054706be3bdc94c61501f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:27:17.358512 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-1dd8ed27-1a31-4146-9f1c-371709e80124 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Going to run 1 instances... {{(pid=120835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:27:17.377682 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-1dd8ed27-1a31-4146-9f1c-371709e80124 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37843ca7-b19a-44f1-acf3-e9432324d4b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:27:17.580932 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-1dd8ed27-1a31-4146-9f1c-371709e80124 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.293618 Aug 17 07:27:17.588771 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 32/60] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:27:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 2302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 07:27:17.593881 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a8325880-aca5-4397-a4ac-794a9112e73b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:17.611774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a8325880-aca5-4397-a4ac-794a9112e73b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:17.637987 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a8325880-aca5-4397-a4ac-794a9112e73b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:17.638556 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a8325880-aca5-4397-a4ac-794a9112e73b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:17.638990 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a8325880-aca5-4397-a4ac-794a9112e73b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:17.641849 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a8325880-aca5-4397-a4ac-794a9112e73b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:17.642495 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a8325880-aca5-4397-a4ac-794a9112e73b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:17.644724 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a8325880-aca5-4397-a4ac-794a9112e73b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:17.914473 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a2809950-e34e-4a7d-b393-edf97c2c8246 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:17.937017 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a2809950-e34e-4a7d-b393-edf97c2c8246 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:17.947471 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a2809950-e34e-4a7d-b393-edf97c2c8246 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:17.952227 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a2809950-e34e-4a7d-b393-edf97c2c8246 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1407 microversion: 2.20 time: 0.900692 Aug 17 07:27:17.989831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 29/61] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:17 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1407 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:27:18.007490 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ff1bf559-81a0-4834-97fb-3e11cfe96e3f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:18.016141 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ff1bf559-81a0-4834-97fb-3e11cfe96e3f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:18.045403 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ff1bf559-81a0-4834-97fb-3e11cfe96e3f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:18.047759 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ff1bf559-81a0-4834-97fb-3e11cfe96e3f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:18.050436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ff1bf559-81a0-4834-97fb-3e11cfe96e3f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:18.053341 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ff1bf559-81a0-4834-97fb-3e11cfe96e3f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:18.053872 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ff1bf559-81a0-4834-97fb-3e11cfe96e3f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:18.058681 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a8325880-aca5-4397-a4ac-794a9112e73b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:18.067089 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a8325880-aca5-4397-a4ac-794a9112e73b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1244 microversion: 2.1 time: 0.476814 Aug 17 07:27:18.068179 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ff1bf559-81a0-4834-97fb-3e11cfe96e3f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:18.077894 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 33/62] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:17 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1244 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:18.108849 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-dc21d7cb-2560-497e-9700-67242760ef5d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:18.112528 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-dc21d7cb-2560-497e-9700-67242760ef5d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:19.457023 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ff1bf559-81a0-4834-97fb-3e11cfe96e3f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:19.465836 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ff1bf559-81a0-4834-97fb-3e11cfe96e3f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1280 microversion: 2.1 time: 1.474514 Aug 17 07:27:19.471470 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 30/63] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:17 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1280 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:19.493595 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-fa76d132-2e0b-4cc5-8bde-2d44e5dd556c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:19.501036 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-fa76d132-2e0b-4cc5-8bde-2d44e5dd556c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:19.521669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fa76d132-2e0b-4cc5-8bde-2d44e5dd556c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:19.524928 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fa76d132-2e0b-4cc5-8bde-2d44e5dd556c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:19.527290 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fa76d132-2e0b-4cc5-8bde-2d44e5dd556c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:19.528227 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fa76d132-2e0b-4cc5-8bde-2d44e5dd556c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:19.540835 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fa76d132-2e0b-4cc5-8bde-2d44e5dd556c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:19.542702 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fa76d132-2e0b-4cc5-8bde-2d44e5dd556c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:19.557748 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-dc21d7cb-2560-497e-9700-67242760ef5d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:19.565713 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-dc21d7cb-2560-497e-9700-67242760ef5d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1238 microversion: 2.1 time: 1.486376 Aug 17 07:27:19.594170 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 34/64] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:18 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1238 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:19.601086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d65cf7fe-50be-46b3-9c44-2eb57676d75e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:19.612877 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d65cf7fe-50be-46b3-9c44-2eb57676d75e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:19.637421 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d65cf7fe-50be-46b3-9c44-2eb57676d75e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:19.642055 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d65cf7fe-50be-46b3-9c44-2eb57676d75e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:19.643119 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d65cf7fe-50be-46b3-9c44-2eb57676d75e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:19.646392 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d65cf7fe-50be-46b3-9c44-2eb57676d75e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:19.646904 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d65cf7fe-50be-46b3-9c44-2eb57676d75e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:19.648480 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d65cf7fe-50be-46b3-9c44-2eb57676d75e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:20.537829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d65cf7fe-50be-46b3-9c44-2eb57676d75e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:20.549289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d65cf7fe-50be-46b3-9c44-2eb57676d75e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:20.550894 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d65cf7fe-50be-46b3-9c44-2eb57676d75e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:20.552042 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d65cf7fe-50be-46b3-9c44-2eb57676d75e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1407 microversion: 2.20 time: 0.954931 Aug 17 07:27:20.566028 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-fa76d132-2e0b-4cc5-8bde-2d44e5dd556c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:20.566028 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-fa76d132-2e0b-4cc5-8bde-2d44e5dd556c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1315 microversion: 2.1 time: 1.087967 Aug 17 07:27:20.566796 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 31/65] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:19 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1315 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:20.570778 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 35/66] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:19 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1407 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:27:20.584460 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-5f958474-d04e-4885-b809-9bd801ec4ffb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:20.585238 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-61f59840-4e1d-47eb-971f-6f489671d470 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:20.585887 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-61f59840-4e1d-47eb-971f-6f489671d470 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:20.587155 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-5f958474-d04e-4885-b809-9bd801ec4ffb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:20.598484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-61f59840-4e1d-47eb-971f-6f489671d470 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:20.599506 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-61f59840-4e1d-47eb-971f-6f489671d470 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:20.599506 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-61f59840-4e1d-47eb-971f-6f489671d470 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:20.603942 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:20.612211 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5f958474-d04e-4885-b809-9bd801ec4ffb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:20.613151 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-61f59840-4e1d-47eb-971f-6f489671d470 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:20.613640 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-61f59840-4e1d-47eb-971f-6f489671d470 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:20.614118 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-61f59840-4e1d-47eb-971f-6f489671d470 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:20.621070 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5f958474-d04e-4885-b809-9bd801ec4ffb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:20.621666 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5f958474-d04e-4885-b809-9bd801ec4ffb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:20.622469 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5f958474-d04e-4885-b809-9bd801ec4ffb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:20.622945 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5f958474-d04e-4885-b809-9bd801ec4ffb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:20.623376 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5f958474-d04e-4885-b809-9bd801ec4ffb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:20.916429 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-5f958474-d04e-4885-b809-9bd801ec4ffb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:20.941352 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-5f958474-d04e-4885-b809-9bd801ec4ffb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1298 microversion: 2.1 time: 0.374093 Aug 17 07:27:20.945000 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 32/67] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:20 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1298 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:20.958448 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-99438224-5393-4954-b1c0-5aec55bf4dce tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:20.959360 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-99438224-5393-4954-b1c0-5aec55bf4dce tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:21.002145 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-99438224-5393-4954-b1c0-5aec55bf4dce tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:21.010427 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-99438224-5393-4954-b1c0-5aec55bf4dce tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:21.010888 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-99438224-5393-4954-b1c0-5aec55bf4dce tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:21.011636 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-99438224-5393-4954-b1c0-5aec55bf4dce tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:21.012138 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-99438224-5393-4954-b1c0-5aec55bf4dce tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:21.012524 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-99438224-5393-4954-b1c0-5aec55bf4dce tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:21.357109 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-99438224-5393-4954-b1c0-5aec55bf4dce tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:21.370848 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-99438224-5393-4954-b1c0-5aec55bf4dce tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1290 microversion: 2.1 time: 0.424555 Aug 17 07:27:21.371648 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 33/68] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:20 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1290 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:21.486522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-61f59840-4e1d-47eb-971f-6f489671d470 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:21.523779 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-61f59840-4e1d-47eb-971f-6f489671d470 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1322 microversion: 2.1 time: 0.950087 Aug 17 07:27:21.524678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 36/69] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:20 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1322 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:21.581147 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-58025acb-310f-443d-9792-70f842afb65a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:21.582465 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-58025acb-310f-443d-9792-70f842afb65a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:21.599085 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-58025acb-310f-443d-9792-70f842afb65a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:21.602230 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b61832f1-95d4-4f8e-bbea-49125e365515 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:21.605167 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-b61832f1-95d4-4f8e-bbea-49125e365515 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:21.605551 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-58025acb-310f-443d-9792-70f842afb65a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:21.606213 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-58025acb-310f-443d-9792-70f842afb65a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:21.607355 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-58025acb-310f-443d-9792-70f842afb65a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:21.608868 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-58025acb-310f-443d-9792-70f842afb65a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:21.618513 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-58025acb-310f-443d-9792-70f842afb65a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:21.621070 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b61832f1-95d4-4f8e-bbea-49125e365515 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:21.621584 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b61832f1-95d4-4f8e-bbea-49125e365515 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:21.622057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b61832f1-95d4-4f8e-bbea-49125e365515 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:21.627944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b61832f1-95d4-4f8e-bbea-49125e365515 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:21.628751 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b61832f1-95d4-4f8e-bbea-49125e365515 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:21.640505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b61832f1-95d4-4f8e-bbea-49125e365515 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:23.567119 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b61832f1-95d4-4f8e-bbea-49125e365515 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:23.588233 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b61832f1-95d4-4f8e-bbea-49125e365515 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1315 microversion: 2.1 time: 1.993993 Aug 17 07:27:23.591484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 37/70] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:21 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1315 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:27:23.607382 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-58025acb-310f-443d-9792-70f842afb65a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:23.608275 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c2930d1b-76c4-4565-968f-7e4b159c67f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:23.610503 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-c2930d1b-76c4-4565-968f-7e4b159c67f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:23.617716 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-58025acb-310f-443d-9792-70f842afb65a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:23.621245 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-58025acb-310f-443d-9792-70f842afb65a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:23.625239 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-58025acb-310f-443d-9792-70f842afb65a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1407 microversion: 2.20 time: 2.050505 Aug 17 07:27:23.630434 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 34/71] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:21 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1407 bytes in 2056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:27:23.647334 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-e5869a50-7cb7-4223-ae6a-28fbeefde0e9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:23.650256 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-e5869a50-7cb7-4223-ae6a-28fbeefde0e9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:23.653126 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=12 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:23.661095 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c2930d1b-76c4-4565-968f-7e4b159c67f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:23.664069 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c2930d1b-76c4-4565-968f-7e4b159c67f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:23.665372 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c2930d1b-76c4-4565-968f-7e4b159c67f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:23.667472 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c2930d1b-76c4-4565-968f-7e4b159c67f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:23.669306 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c2930d1b-76c4-4565-968f-7e4b159c67f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:23.670484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c2930d1b-76c4-4565-968f-7e4b159c67f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:23.673389 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e5869a50-7cb7-4223-ae6a-28fbeefde0e9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:23.679202 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e5869a50-7cb7-4223-ae6a-28fbeefde0e9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:23.681378 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e5869a50-7cb7-4223-ae6a-28fbeefde0e9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:23.686513 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e5869a50-7cb7-4223-ae6a-28fbeefde0e9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:23.689101 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e5869a50-7cb7-4223-ae6a-28fbeefde0e9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:23.689577 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e5869a50-7cb7-4223-ae6a-28fbeefde0e9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:24.079432 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-e5869a50-7cb7-4223-ae6a-28fbeefde0e9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:24.081295 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c2930d1b-76c4-4565-968f-7e4b159c67f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:24.092856 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-c2930d1b-76c4-4565-968f-7e4b159c67f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1298 microversion: 2.1 time: 0.499441 Aug 17 07:27:24.098324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 38/72] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:23 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1298 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:24.102210 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-e5869a50-7cb7-4223-ae6a-28fbeefde0e9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1296 microversion: 2.1 time: 0.463131 Aug 17 07:27:24.103059 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 35/73] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:23 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1296 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:24.113468 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-7950780c-0671-458a-9544-f810b5e8a2f9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:24.114293 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-7950780c-0671-458a-9544-f810b5e8a2f9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:24.124570 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7950780c-0671-458a-9544-f810b5e8a2f9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:24.125058 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7950780c-0671-458a-9544-f810b5e8a2f9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:24.125543 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7950780c-0671-458a-9544-f810b5e8a2f9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:24.129016 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7950780c-0671-458a-9544-f810b5e8a2f9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:24.129511 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7950780c-0671-458a-9544-f810b5e8a2f9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:24.129978 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7950780c-0671-458a-9544-f810b5e8a2f9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:24.461908 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-a8b85947-2476-4e7f-ab8d-a377eaa11ac8 req-a317c848-eeaf-4439-bd4c-7db0d0a8fb28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b55345ed-b67a-4e85-aa91-a1351ca5fdf1", "tag": "1d23fdf6-efa9-43ab-a1df-ef927886dc2e"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:24.505660 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-a8b85947-2476-4e7f-ab8d-a377eaa11ac8 req-a317c848-eeaf-4439-bd4c-7db0d0a8fb28 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:24.506349 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-a8b85947-2476-4e7f-ab8d-a377eaa11ac8 req-a317c848-eeaf-4439-bd4c-7db0d0a8fb28 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:24.506711 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-a8b85947-2476-4e7f-ab8d-a377eaa11ac8 req-a317c848-eeaf-4439-bd4c-7db0d0a8fb28 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:24.576825 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-a8b85947-2476-4e7f-ab8d-a377eaa11ac8 req-a317c848-eeaf-4439-bd4c-7db0d0a8fb28 service nova] Creating event network-changed:1d23fdf6-efa9-43ab-a1df-ef927886dc2e for instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 on hv-cinder-85312 Aug 17 07:27:24.577354 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-a8b85947-2476-4e7f-ab8d-a377eaa11ac8 req-a317c848-eeaf-4439-bd4c-7db0d0a8fb28 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120834) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 17 07:27:24.577738 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-a8b85947-2476-4e7f-ab8d-a377eaa11ac8 req-a317c848-eeaf-4439-bd4c-7db0d0a8fb28 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120834) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 17 07:27:24.578859 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8dd3d87-2941-4ed4-a477-3b1ca8d154f6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:24.585762 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8dd3d87-2941-4ed4-a477-3b1ca8d154f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:24.587051 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8dd3d87-2941-4ed4-a477-3b1ca8d154f6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:24.589994 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8dd3d87-2941-4ed4-a477-3b1ca8d154f6 None None] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:24.593918 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8dd3d87-2941-4ed4-a477-3b1ca8d154f6 None None] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:24.594650 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8dd3d87-2941-4ed4-a477-3b1ca8d154f6 None None] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:24.619119 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.compute.rpcapi [None req-d8dd3d87-2941-4ed4-a477-3b1ca8d154f6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 17 07:27:24.620720 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8dd3d87-2941-4ed4-a477-3b1ca8d154f6 None None] Releasing lock "compute-rpcapi-router" {{(pid=120834) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 17 07:27:24.626293 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-7950780c-0671-458a-9544-f810b5e8a2f9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:24.634835 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-7950780c-0671-458a-9544-f810b5e8a2f9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1322 microversion: 2.1 time: 0.535222 Aug 17 07:27:24.638273 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 39/74] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:24 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1322 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:24.663822 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-d8dd3d87-2941-4ed4-a477-3b1ca8d154f6 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.558802 Aug 17 07:27:24.664725 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 36/75] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:27:24.672311 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-cd0ad638-baac-488f-a3ae-5a5c2ba4c2c3 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:24.673283 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-cd0ad638-baac-488f-a3ae-5a5c2ba4c2c3 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:24.691225 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cd0ad638-baac-488f-a3ae-5a5c2ba4c2c3 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:24.691933 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cd0ad638-baac-488f-a3ae-5a5c2ba4c2c3 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:24.693387 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cd0ad638-baac-488f-a3ae-5a5c2ba4c2c3 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:24.696664 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cd0ad638-baac-488f-a3ae-5a5c2ba4c2c3 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:24.697238 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cd0ad638-baac-488f-a3ae-5a5c2ba4c2c3 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:24.697835 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cd0ad638-baac-488f-a3ae-5a5c2ba4c2c3 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:24.882568 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-eac35969-d22b-4fe8-afec-52887aab220f req-5450e444-92fa-43c6-a4e8-142018246437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ebfec5b-68c1-41cd-910b-e73220fc2fd6", "tag": "dc7af87b-fe16-4334-a953-7e5e2d03e8e7"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:24.903729 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-eac35969-d22b-4fe8-afec-52887aab220f req-5450e444-92fa-43c6-a4e8-142018246437 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:24.908064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-eac35969-d22b-4fe8-afec-52887aab220f req-5450e444-92fa-43c6-a4e8-142018246437 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:24.909934 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-eac35969-d22b-4fe8-afec-52887aab220f req-5450e444-92fa-43c6-a4e8-142018246437 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:24.962089 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-eac35969-d22b-4fe8-afec-52887aab220f req-5450e444-92fa-43c6-a4e8-142018246437 service nova] Creating event network-changed:dc7af87b-fe16-4334-a953-7e5e2d03e8e7 for instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 on hv-cinder-85312 Aug 17 07:27:24.963527 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-eac35969-d22b-4fe8-afec-52887aab220f req-5450e444-92fa-43c6-a4e8-142018246437 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120835) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 17 07:27:24.968495 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-eac35969-d22b-4fe8-afec-52887aab220f req-5450e444-92fa-43c6-a4e8-142018246437 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120835) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 17 07:27:24.970447 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-70bac1db-7990-4d7f-99bc-d0b6d0bdd195 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:24.973296 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-70bac1db-7990-4d7f-99bc-d0b6d0bdd195 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:24.974015 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-70bac1db-7990-4d7f-99bc-d0b6d0bdd195 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:24.975007 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-70bac1db-7990-4d7f-99bc-d0b6d0bdd195 None None] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:24.976549 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-70bac1db-7990-4d7f-99bc-d0b6d0bdd195 None None] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:24.977716 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-70bac1db-7990-4d7f-99bc-d0b6d0bdd195 None None] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:24.997442 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.compute.rpcapi [None req-70bac1db-7990-4d7f-99bc-d0b6d0bdd195 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 17 07:27:25.001393 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-70bac1db-7990-4d7f-99bc-d0b6d0bdd195 None None] Releasing lock "compute-rpcapi-router" {{(pid=120835) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 17 07:27:25.024359 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-70bac1db-7990-4d7f-99bc-d0b6d0bdd195 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.384826 Aug 17 07:27:25.025494 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 40/76] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:27:25.032031 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3327163b-c211-431f-8ec2-b81912a2603b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:25.033065 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-3327163b-c211-431f-8ec2-b81912a2603b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:25.041078 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3327163b-c211-431f-8ec2-b81912a2603b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:25.041781 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3327163b-c211-431f-8ec2-b81912a2603b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:25.042448 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3327163b-c211-431f-8ec2-b81912a2603b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:25.043379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3327163b-c211-431f-8ec2-b81912a2603b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:25.044032 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3327163b-c211-431f-8ec2-b81912a2603b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:25.044854 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3327163b-c211-431f-8ec2-b81912a2603b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:25.485836 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3327163b-c211-431f-8ec2-b81912a2603b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:25.512517 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3327163b-c211-431f-8ec2-b81912a2603b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:25.517054 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3327163b-c211-431f-8ec2-b81912a2603b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:25.532653 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-3327163b-c211-431f-8ec2-b81912a2603b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1407 microversion: 2.20 time: 0.505631 Aug 17 07:27:25.537338 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 41/77] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:25 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1407 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:27:25.568339 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-f6f5a336-4ed5-4dff-a6a2-be921379702d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:25.577338 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-cd0ad638-baac-488f-a3ae-5a5c2ba4c2c3 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:25.590018 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-cd0ad638-baac-488f-a3ae-5a5c2ba4c2c3 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1315 microversion: 2.1 time: 0.924067 Aug 17 07:27:25.590595 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 37/78] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:24 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1315 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:25.591087 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-f6f5a336-4ed5-4dff-a6a2-be921379702d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:25.632052 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f6f5a336-4ed5-4dff-a6a2-be921379702d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:25.638347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f6f5a336-4ed5-4dff-a6a2-be921379702d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:25.639303 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f6f5a336-4ed5-4dff-a6a2-be921379702d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:25.639747 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-43e14e9f-20eb-44c3-b320-5573d6d2483a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:25.641149 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-43e14e9f-20eb-44c3-b320-5573d6d2483a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:25.642206 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f6f5a336-4ed5-4dff-a6a2-be921379702d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:25.644439 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f6f5a336-4ed5-4dff-a6a2-be921379702d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:25.646543 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f6f5a336-4ed5-4dff-a6a2-be921379702d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:25.669345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-43e14e9f-20eb-44c3-b320-5573d6d2483a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:25.670311 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-43e14e9f-20eb-44c3-b320-5573d6d2483a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:25.673775 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-43e14e9f-20eb-44c3-b320-5573d6d2483a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:25.675484 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-43e14e9f-20eb-44c3-b320-5573d6d2483a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:25.677912 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-43e14e9f-20eb-44c3-b320-5573d6d2483a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:25.679850 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-43e14e9f-20eb-44c3-b320-5573d6d2483a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:25.948196 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-f6f5a336-4ed5-4dff-a6a2-be921379702d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:25.967523 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-f6f5a336-4ed5-4dff-a6a2-be921379702d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1296 microversion: 2.1 time: 0.428563 Aug 17 07:27:25.968464 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 42/79] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:25 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1296 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:25.982340 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d19a442c-c2cf-45a3-825f-76c81d4d5463 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:25.988039 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d19a442c-c2cf-45a3-825f-76c81d4d5463 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:26.006155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d19a442c-c2cf-45a3-825f-76c81d4d5463 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:26.011221 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d19a442c-c2cf-45a3-825f-76c81d4d5463 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:26.012060 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d19a442c-c2cf-45a3-825f-76c81d4d5463 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:26.016814 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d19a442c-c2cf-45a3-825f-76c81d4d5463 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:26.017549 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d19a442c-c2cf-45a3-825f-76c81d4d5463 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:26.019836 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d19a442c-c2cf-45a3-825f-76c81d4d5463 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:26.143787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=28 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:27.165042 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-43e14e9f-20eb-44c3-b320-5573d6d2483a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:27.176882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-43e14e9f-20eb-44c3-b320-5573d6d2483a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1365 microversion: 2.1 time: 1.564551 Aug 17 07:27:27.184670 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 38/80] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:25 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1365 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:27.221138 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-3317a06d-bc02-486c-8597-0a2f15a593b7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:27.226354 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-3317a06d-bc02-486c-8597-0a2f15a593b7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:27.247799 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3317a06d-bc02-486c-8597-0a2f15a593b7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:27.248705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3317a06d-bc02-486c-8597-0a2f15a593b7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:27.250183 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3317a06d-bc02-486c-8597-0a2f15a593b7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:27.253636 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3317a06d-bc02-486c-8597-0a2f15a593b7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:27.270940 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3317a06d-bc02-486c-8597-0a2f15a593b7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:27.273233 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3317a06d-bc02-486c-8597-0a2f15a593b7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:27.339746 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=100 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:27.511860 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d19a442c-c2cf-45a3-825f-76c81d4d5463 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:27.526055 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d19a442c-c2cf-45a3-825f-76c81d4d5463 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1322 microversion: 2.1 time: 1.556127 Aug 17 07:27:27.540285 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 43/81] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:25 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1322 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:27.546288 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-66b23c52-43fa-43bf-9e8e-4976c96424ab tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:27.547860 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-66b23c52-43fa-43bf-9e8e-4976c96424ab tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:27.555342 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-66b23c52-43fa-43bf-9e8e-4976c96424ab tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:27.556231 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-66b23c52-43fa-43bf-9e8e-4976c96424ab tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:27.556902 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-66b23c52-43fa-43bf-9e8e-4976c96424ab tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:27.557891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-66b23c52-43fa-43bf-9e8e-4976c96424ab tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:27.558577 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-66b23c52-43fa-43bf-9e8e-4976c96424ab tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:27.559209 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-66b23c52-43fa-43bf-9e8e-4976c96424ab tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:27.593087 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=100 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:27.914374 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-66b23c52-43fa-43bf-9e8e-4976c96424ab tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:27.922345 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-66b23c52-43fa-43bf-9e8e-4976c96424ab tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1315 microversion: 2.1 time: 0.380511 Aug 17 07:27:27.927986 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 44/82] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:27 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:27.938431 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-7e67f725-d146-4b6e-95dd-698c1d00e424 req-4660aab4-f442-404f-917d-5cd15cfcdae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf0f55a4-d90a-443c-85c1-37216c95aa7a", "tag": "60c1b470-3d85-4b92-8000-58ca0fee2484"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:27.948158 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-7e67f725-d146-4b6e-95dd-698c1d00e424 req-4660aab4-f442-404f-917d-5cd15cfcdae7 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:27.948506 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-7e67f725-d146-4b6e-95dd-698c1d00e424 req-4660aab4-f442-404f-917d-5cd15cfcdae7 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:27.949262 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-7e67f725-d146-4b6e-95dd-698c1d00e424 req-4660aab4-f442-404f-917d-5cd15cfcdae7 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:27.964879 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-7e67f725-d146-4b6e-95dd-698c1d00e424 req-4660aab4-f442-404f-917d-5cd15cfcdae7 service nova] Creating event network-changed:60c1b470-3d85-4b92-8000-58ca0fee2484 for instance bf0f55a4-d90a-443c-85c1-37216c95aa7a on hv-cinder-85312 Aug 17 07:27:27.970271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-7e67f725-d146-4b6e-95dd-698c1d00e424 req-4660aab4-f442-404f-917d-5cd15cfcdae7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040830 Aug 17 07:27:27.972442 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 45/83] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:27:27.977888 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a719df9c-1495-4f75-9095-565b1e320ca8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:27.978491 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a719df9c-1495-4f75-9095-565b1e320ca8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:27.985735 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a719df9c-1495-4f75-9095-565b1e320ca8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:27.986220 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a719df9c-1495-4f75-9095-565b1e320ca8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:27.986732 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a719df9c-1495-4f75-9095-565b1e320ca8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:27.987492 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a719df9c-1495-4f75-9095-565b1e320ca8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:27.987899 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a719df9c-1495-4f75-9095-565b1e320ca8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:27.988285 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a719df9c-1495-4f75-9095-565b1e320ca8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:28.048658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-3317a06d-bc02-486c-8597-0a2f15a593b7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:28.064476 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-3317a06d-bc02-486c-8597-0a2f15a593b7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:28.066471 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-3317a06d-bc02-486c-8597-0a2f15a593b7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:28.067590 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-3317a06d-bc02-486c-8597-0a2f15a593b7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1407 microversion: 2.20 time: 0.881634 Aug 17 07:27:28.077565 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 39/84] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:27 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1407 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:27:28.085503 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-7b2605af-addb-4116-b907-87a0968c617e req-da3a7027-4eb0-47ba-9bca-1b0e1717f7ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "479d4f33-9d2a-4cec-84c9-18c739e2374f", "tag": "3605db22-3f80-4c4c-927b-ba43e6ba88ef"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:28.095504 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-7b2605af-addb-4116-b907-87a0968c617e req-da3a7027-4eb0-47ba-9bca-1b0e1717f7ed service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:28.095988 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-7b2605af-addb-4116-b907-87a0968c617e req-da3a7027-4eb0-47ba-9bca-1b0e1717f7ed service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:28.096419 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-7b2605af-addb-4116-b907-87a0968c617e req-da3a7027-4eb0-47ba-9bca-1b0e1717f7ed service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:28.109918 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-7b2605af-addb-4116-b907-87a0968c617e req-da3a7027-4eb0-47ba-9bca-1b0e1717f7ed service nova] Creating event network-changed:3605db22-3f80-4c4c-927b-ba43e6ba88ef for instance 479d4f33-9d2a-4cec-84c9-18c739e2374f on hv-cinder-85312 Aug 17 07:27:28.115630 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-7b2605af-addb-4116-b907-87a0968c617e req-da3a7027-4eb0-47ba-9bca-1b0e1717f7ed service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039847 Aug 17 07:27:28.116227 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 40/85] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:27:28.198041 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-94fac3a8-0339-4e46-bea9-e2e595282310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:28.198741 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-94fac3a8-0339-4e46-bea9-e2e595282310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:28.206576 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94fac3a8-0339-4e46-bea9-e2e595282310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:28.207290 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94fac3a8-0339-4e46-bea9-e2e595282310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:28.207882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94fac3a8-0339-4e46-bea9-e2e595282310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:28.208755 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94fac3a8-0339-4e46-bea9-e2e595282310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:28.209351 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94fac3a8-0339-4e46-bea9-e2e595282310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:28.210117 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94fac3a8-0339-4e46-bea9-e2e595282310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:28.403112 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a719df9c-1495-4f75-9095-565b1e320ca8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:28.418550 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a719df9c-1495-4f75-9095-565b1e320ca8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1364 microversion: 2.1 time: 0.442687 Aug 17 07:27:28.430966 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 46/86] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:27 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1364 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:28.549018 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d021a490-e61b-4be1-ba93-968a3c1c5175 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:28.549620 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d021a490-e61b-4be1-ba93-968a3c1c5175 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:28.558797 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d021a490-e61b-4be1-ba93-968a3c1c5175 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:28.560854 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d021a490-e61b-4be1-ba93-968a3c1c5175 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:28.561359 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d021a490-e61b-4be1-ba93-968a3c1c5175 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:28.567210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d021a490-e61b-4be1-ba93-968a3c1c5175 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:28.567782 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d021a490-e61b-4be1-ba93-968a3c1c5175 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:28.568407 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d021a490-e61b-4be1-ba93-968a3c1c5175 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:28.631784 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-94fac3a8-0339-4e46-bea9-e2e595282310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:28.643186 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-94fac3a8-0339-4e46-bea9-e2e595282310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1365 microversion: 2.1 time: 0.448725 Aug 17 07:27:28.645107 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 41/87] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:28 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1365 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:27:28.857040 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d021a490-e61b-4be1-ba93-968a3c1c5175 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:28.873770 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d021a490-e61b-4be1-ba93-968a3c1c5175 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1322 microversion: 2.1 time: 0.328939 Aug 17 07:27:28.874695 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 47/88] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:28 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:28.946375 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-6572dfb3-a133-460e-898e-313398c6a484 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:28.947167 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-6572dfb3-a133-460e-898e-313398c6a484 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:28.956112 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6572dfb3-a133-460e-898e-313398c6a484 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:28.957023 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6572dfb3-a133-460e-898e-313398c6a484 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:28.957745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6572dfb3-a133-460e-898e-313398c6a484 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:28.958963 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6572dfb3-a133-460e-898e-313398c6a484 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:28.959604 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6572dfb3-a133-460e-898e-313398c6a484 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:28.960559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6572dfb3-a133-460e-898e-313398c6a484 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:29.090298 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c039e56c-9334-47e2-b752-2d07db5fe305 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:29.090922 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-c039e56c-9334-47e2-b752-2d07db5fe305 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:29.098608 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c039e56c-9334-47e2-b752-2d07db5fe305 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:29.099272 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c039e56c-9334-47e2-b752-2d07db5fe305 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:29.099883 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c039e56c-9334-47e2-b752-2d07db5fe305 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:29.100587 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c039e56c-9334-47e2-b752-2d07db5fe305 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:29.101189 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c039e56c-9334-47e2-b752-2d07db5fe305 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:29.101908 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c039e56c-9334-47e2-b752-2d07db5fe305 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:29.272511 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-6572dfb3-a133-460e-898e-313398c6a484 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:29.283482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-6572dfb3-a133-460e-898e-313398c6a484 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1315 microversion: 2.1 time: 0.337915 Aug 17 07:27:29.283482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 42/89] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:28 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:29.341182 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c039e56c-9334-47e2-b752-2d07db5fe305 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:29.350963 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c039e56c-9334-47e2-b752-2d07db5fe305 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:29.352513 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c039e56c-9334-47e2-b752-2d07db5fe305 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:29.353643 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-c039e56c-9334-47e2-b752-2d07db5fe305 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1407 microversion: 2.20 time: 0.267243 Aug 17 07:27:29.354211 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 48/90] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:29 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:27:29.447636 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0da48e5b-1fd2-4229-bdb9-d4c8f2d425f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:29.448561 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0da48e5b-1fd2-4229-bdb9-d4c8f2d425f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:29.458366 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0da48e5b-1fd2-4229-bdb9-d4c8f2d425f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:29.459247 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0da48e5b-1fd2-4229-bdb9-d4c8f2d425f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:29.459849 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0da48e5b-1fd2-4229-bdb9-d4c8f2d425f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:29.461135 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0da48e5b-1fd2-4229-bdb9-d4c8f2d425f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:29.461860 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0da48e5b-1fd2-4229-bdb9-d4c8f2d425f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:29.462546 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0da48e5b-1fd2-4229-bdb9-d4c8f2d425f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:29.667075 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c1d6a2b1-da09-482b-b2a4-0c2ff9402a17 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:29.668520 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-c1d6a2b1-da09-482b-b2a4-0c2ff9402a17 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:29.679555 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=28 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:29.682525 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c1d6a2b1-da09-482b-b2a4-0c2ff9402a17 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:29.683264 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c1d6a2b1-da09-482b-b2a4-0c2ff9402a17 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:29.683983 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c1d6a2b1-da09-482b-b2a4-0c2ff9402a17 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:29.685050 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c1d6a2b1-da09-482b-b2a4-0c2ff9402a17 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:29.685827 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c1d6a2b1-da09-482b-b2a4-0c2ff9402a17 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:29.686568 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c1d6a2b1-da09-482b-b2a4-0c2ff9402a17 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:29.835091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0da48e5b-1fd2-4229-bdb9-d4c8f2d425f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:29.842995 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0da48e5b-1fd2-4229-bdb9-d4c8f2d425f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1364 microversion: 2.1 time: 0.402339 Aug 17 07:27:29.843798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 43/91] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:29 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1364 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:29.896512 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-e1269743-8f6f-41ce-ad82-e276dd1e2052 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:29.897379 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-e1269743-8f6f-41ce-ad82-e276dd1e2052 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:29.906600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e1269743-8f6f-41ce-ad82-e276dd1e2052 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:29.907140 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e1269743-8f6f-41ce-ad82-e276dd1e2052 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:29.908068 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e1269743-8f6f-41ce-ad82-e276dd1e2052 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:29.908968 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e1269743-8f6f-41ce-ad82-e276dd1e2052 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:29.909593 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e1269743-8f6f-41ce-ad82-e276dd1e2052 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:29.910198 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e1269743-8f6f-41ce-ad82-e276dd1e2052 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:29.914072 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c1d6a2b1-da09-482b-b2a4-0c2ff9402a17 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:29.923285 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-c1d6a2b1-da09-482b-b2a4-0c2ff9402a17 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1365 microversion: 2.1 time: 0.261455 Aug 17 07:27:29.924591 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 49/92] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:29 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:30.004578 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-9aa0a256-ccca-40f6-8a60-c11665280512 req-b42aedfe-2ceb-419f-9530-202f76c6a41f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d1495a-563e-4c4f-ba8c-1fa046813a22", "tag": "4baae37f-d765-4b53-bd78-8bf3e3c5f440"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:30.016895 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-9aa0a256-ccca-40f6-8a60-c11665280512 req-b42aedfe-2ceb-419f-9530-202f76c6a41f service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:30.017842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-9aa0a256-ccca-40f6-8a60-c11665280512 req-b42aedfe-2ceb-419f-9530-202f76c6a41f service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:30.018299 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-9aa0a256-ccca-40f6-8a60-c11665280512 req-b42aedfe-2ceb-419f-9530-202f76c6a41f service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:30.032713 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-9aa0a256-ccca-40f6-8a60-c11665280512 req-b42aedfe-2ceb-419f-9530-202f76c6a41f service nova] Creating event network-changed:4baae37f-d765-4b53-bd78-8bf3e3c5f440 for instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 on hv-cinder-85312 Aug 17 07:27:30.039185 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-9aa0a256-ccca-40f6-8a60-c11665280512 req-b42aedfe-2ceb-419f-9530-202f76c6a41f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040654 Aug 17 07:27:30.040107 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 50/93] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:27:30.106158 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-e1269743-8f6f-41ce-ad82-e276dd1e2052 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:30.115850 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-e1269743-8f6f-41ce-ad82-e276dd1e2052 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1322 microversion: 2.1 time: 0.222923 Aug 17 07:27:30.117698 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 44/94] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:29 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:30.209290 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-8d48d1ff-d208-42d6-80a4-4f0655f33f86 req-dbdbe919-1352-460e-94c6-492a94670e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15365fa0-3501-49cd-a3d5-9ac53d13169f", "tag": "b2367014-b108-400d-a29f-670f07d2bad0"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:30.229400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-8d48d1ff-d208-42d6-80a4-4f0655f33f86 req-dbdbe919-1352-460e-94c6-492a94670e1b service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:30.229890 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-8d48d1ff-d208-42d6-80a4-4f0655f33f86 req-dbdbe919-1352-460e-94c6-492a94670e1b service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:30.230351 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-8d48d1ff-d208-42d6-80a4-4f0655f33f86 req-dbdbe919-1352-460e-94c6-492a94670e1b service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:30.250103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-8d48d1ff-d208-42d6-80a4-4f0655f33f86 req-dbdbe919-1352-460e-94c6-492a94670e1b service nova] Creating event network-changed:b2367014-b108-400d-a29f-670f07d2bad0 for instance 15365fa0-3501-49cd-a3d5-9ac53d13169f on hv-cinder-85312 Aug 17 07:27:30.256868 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-8d48d1ff-d208-42d6-80a4-4f0655f33f86 req-dbdbe919-1352-460e-94c6-492a94670e1b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051293 Aug 17 07:27:30.258865 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 51/95] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:27:30.302148 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-4ef0f406-22a8-4874-94bf-aed41567522a tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:30.302832 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-4ef0f406-22a8-4874-94bf-aed41567522a tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:30.310386 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4ef0f406-22a8-4874-94bf-aed41567522a tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:30.311189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4ef0f406-22a8-4874-94bf-aed41567522a tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:30.312109 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4ef0f406-22a8-4874-94bf-aed41567522a tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:30.313062 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4ef0f406-22a8-4874-94bf-aed41567522a tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:30.313751 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4ef0f406-22a8-4874-94bf-aed41567522a tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:30.314397 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4ef0f406-22a8-4874-94bf-aed41567522a tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:30.378680 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ceb67653-6019-4080-90e8-7353238ce01d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:30.379504 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-ceb67653-6019-4080-90e8-7353238ce01d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:30.389377 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ceb67653-6019-4080-90e8-7353238ce01d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:30.391941 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ceb67653-6019-4080-90e8-7353238ce01d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:30.394142 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ceb67653-6019-4080-90e8-7353238ce01d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:30.395716 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ceb67653-6019-4080-90e8-7353238ce01d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:30.398835 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ceb67653-6019-4080-90e8-7353238ce01d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:30.399308 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ceb67653-6019-4080-90e8-7353238ce01d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:30.526841 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-4ef0f406-22a8-4874-94bf-aed41567522a tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:30.538670 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-4ef0f406-22a8-4874-94bf-aed41567522a tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1315 microversion: 2.1 time: 0.240228 Aug 17 07:27:30.540035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 45/96] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:30 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:30.613013 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ceb67653-6019-4080-90e8-7353238ce01d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:30.626822 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ceb67653-6019-4080-90e8-7353238ce01d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:30.628516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ceb67653-6019-4080-90e8-7353238ce01d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:30.629926 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-ceb67653-6019-4080-90e8-7353238ce01d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1407 microversion: 2.20 time: 0.257061 Aug 17 07:27:30.630558 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 52/97] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:30 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:27:30.866455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9bc89331-487b-4b43-9a9c-b716c50ee7c5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:30.867459 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9bc89331-487b-4b43-9a9c-b716c50ee7c5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:30.874379 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9bc89331-487b-4b43-9a9c-b716c50ee7c5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:30.875310 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9bc89331-487b-4b43-9a9c-b716c50ee7c5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:30.875810 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9bc89331-487b-4b43-9a9c-b716c50ee7c5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:30.876747 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9bc89331-487b-4b43-9a9c-b716c50ee7c5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:30.877404 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9bc89331-487b-4b43-9a9c-b716c50ee7c5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:30.877917 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9bc89331-487b-4b43-9a9c-b716c50ee7c5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:30.944689 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-0c17facc-3c49-46da-9b15-3d22a05784b9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:30.945921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-0c17facc-3c49-46da-9b15-3d22a05784b9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:30.952796 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0c17facc-3c49-46da-9b15-3d22a05784b9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:30.953832 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0c17facc-3c49-46da-9b15-3d22a05784b9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:30.954471 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0c17facc-3c49-46da-9b15-3d22a05784b9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:30.955324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0c17facc-3c49-46da-9b15-3d22a05784b9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:30.955999 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0c17facc-3c49-46da-9b15-3d22a05784b9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:30.957425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0c17facc-3c49-46da-9b15-3d22a05784b9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:31.144228 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-9bc89331-487b-4b43-9a9c-b716c50ee7c5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:31.156093 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9bc89331-487b-4b43-9a9c-b716c50ee7c5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1364 microversion: 2.1 time: 0.295102 Aug 17 07:27:31.157291 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 46/98] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:30 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1364 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:31.171355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-0c17facc-3c49-46da-9b15-3d22a05784b9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:31.173520 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7a385bd9-6a52-408e-bc57-75aad7db2104 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:31.174266 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-7a385bd9-6a52-408e-bc57-75aad7db2104 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:31.180901 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7a385bd9-6a52-408e-bc57-75aad7db2104 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:31.181386 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7a385bd9-6a52-408e-bc57-75aad7db2104 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:31.182156 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7a385bd9-6a52-408e-bc57-75aad7db2104 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:31.182802 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-0c17facc-3c49-46da-9b15-3d22a05784b9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1365 microversion: 2.1 time: 0.241955 Aug 17 07:27:31.183162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7a385bd9-6a52-408e-bc57-75aad7db2104 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:31.183610 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7a385bd9-6a52-408e-bc57-75aad7db2104 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:31.183913 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 53/99] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:30 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:27:31.184214 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7a385bd9-6a52-408e-bc57-75aad7db2104 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:31.341004 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-7a385bd9-6a52-408e-bc57-75aad7db2104 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:31.349254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-7a385bd9-6a52-408e-bc57-75aad7db2104 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1322 microversion: 2.1 time: 0.190670 Aug 17 07:27:31.349815 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 47/100] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:31 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:31.559801 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a496df51-94bf-4cf3-9676-cabb543c86a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:31.560438 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a496df51-94bf-4cf3-9676-cabb543c86a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:31.566953 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a496df51-94bf-4cf3-9676-cabb543c86a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:31.567548 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a496df51-94bf-4cf3-9676-cabb543c86a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:31.567862 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a496df51-94bf-4cf3-9676-cabb543c86a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:31.568544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a496df51-94bf-4cf3-9676-cabb543c86a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:31.569154 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a496df51-94bf-4cf3-9676-cabb543c86a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:31.569780 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a496df51-94bf-4cf3-9676-cabb543c86a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:31.652496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b83d1460-cb5b-4c3a-9ea5-99c575f9d289 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:31.653135 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-b83d1460-cb5b-4c3a-9ea5-99c575f9d289 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:31.661721 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b83d1460-cb5b-4c3a-9ea5-99c575f9d289 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:31.663474 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b83d1460-cb5b-4c3a-9ea5-99c575f9d289 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:31.664012 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b83d1460-cb5b-4c3a-9ea5-99c575f9d289 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:31.664781 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b83d1460-cb5b-4c3a-9ea5-99c575f9d289 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:31.665346 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b83d1460-cb5b-4c3a-9ea5-99c575f9d289 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:31.665783 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b83d1460-cb5b-4c3a-9ea5-99c575f9d289 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:31.707808 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a496df51-94bf-4cf3-9676-cabb543c86a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:31.719653 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a496df51-94bf-4cf3-9676-cabb543c86a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1315 microversion: 2.1 time: 0.162830 Aug 17 07:27:31.720379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 54/101] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:31 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:31.846256 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-b83d1460-cb5b-4c3a-9ea5-99c575f9d289 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:31.860269 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-b83d1460-cb5b-4c3a-9ea5-99c575f9d289 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:31.861887 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-b83d1460-cb5b-4c3a-9ea5-99c575f9d289 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:31.863244 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b83d1460-cb5b-4c3a-9ea5-99c575f9d289 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1407 microversion: 2.20 time: 0.214343 Aug 17 07:27:31.863953 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 48/102] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:31 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:27:32.177610 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-116e47dc-d6f6-4e6a-9a7e-07199d35e8ff tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:32.178453 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-116e47dc-d6f6-4e6a-9a7e-07199d35e8ff tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:32.184896 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-116e47dc-d6f6-4e6a-9a7e-07199d35e8ff tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:32.185578 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-116e47dc-d6f6-4e6a-9a7e-07199d35e8ff tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:32.186163 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-116e47dc-d6f6-4e6a-9a7e-07199d35e8ff tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:32.187016 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-116e47dc-d6f6-4e6a-9a7e-07199d35e8ff tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:32.187574 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-116e47dc-d6f6-4e6a-9a7e-07199d35e8ff tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:32.188794 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-116e47dc-d6f6-4e6a-9a7e-07199d35e8ff tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:32.203715 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9f419096-8691-4ba8-bbf9-ddbc7ec8cbc1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:32.204481 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9f419096-8691-4ba8-bbf9-ddbc7ec8cbc1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:32.218172 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9f419096-8691-4ba8-bbf9-ddbc7ec8cbc1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:32.218849 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9f419096-8691-4ba8-bbf9-ddbc7ec8cbc1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:32.219587 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9f419096-8691-4ba8-bbf9-ddbc7ec8cbc1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:32.220184 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9f419096-8691-4ba8-bbf9-ddbc7ec8cbc1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:32.220766 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9f419096-8691-4ba8-bbf9-ddbc7ec8cbc1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:32.221292 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9f419096-8691-4ba8-bbf9-ddbc7ec8cbc1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:32.454202 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-9f419096-8691-4ba8-bbf9-ddbc7ec8cbc1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:32.466695 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9f419096-8691-4ba8-bbf9-ddbc7ec8cbc1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1365 microversion: 2.1 time: 0.266580 Aug 17 07:27:32.466970 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 49/103] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:32 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:32.472125 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-343dffa7-51ae-4821-b9cb-0bd654f26b09 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:32.472726 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-343dffa7-51ae-4821-b9cb-0bd654f26b09 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:32.488414 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-343dffa7-51ae-4821-b9cb-0bd654f26b09 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:32.488745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-343dffa7-51ae-4821-b9cb-0bd654f26b09 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:32.489718 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-343dffa7-51ae-4821-b9cb-0bd654f26b09 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:32.490618 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-343dffa7-51ae-4821-b9cb-0bd654f26b09 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:32.491215 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-343dffa7-51ae-4821-b9cb-0bd654f26b09 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:32.492283 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-343dffa7-51ae-4821-b9cb-0bd654f26b09 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:32.501187 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-116e47dc-d6f6-4e6a-9a7e-07199d35e8ff tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:32.509697 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-116e47dc-d6f6-4e6a-9a7e-07199d35e8ff tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1364 microversion: 2.1 time: 0.336072 Aug 17 07:27:32.512360 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 55/104] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:32 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1364 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:32.722564 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-343dffa7-51ae-4821-b9cb-0bd654f26b09 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:32.729895 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-343dffa7-51ae-4821-b9cb-0bd654f26b09 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1322 microversion: 2.1 time: 0.261811 Aug 17 07:27:32.733207 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 50/105] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:32 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:32.751157 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2578227a-f98b-4bac-8817-595cea158e48 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:32.751952 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-2578227a-f98b-4bac-8817-595cea158e48 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:32.758063 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2578227a-f98b-4bac-8817-595cea158e48 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:32.758740 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2578227a-f98b-4bac-8817-595cea158e48 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:32.759321 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2578227a-f98b-4bac-8817-595cea158e48 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:32.760216 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2578227a-f98b-4bac-8817-595cea158e48 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:32.760663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2578227a-f98b-4bac-8817-595cea158e48 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:32.761229 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2578227a-f98b-4bac-8817-595cea158e48 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:32.886633 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-2bbef404-5168-4d67-be82-fca818d35d27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:32.887320 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-2bbef404-5168-4d67-be82-fca818d35d27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:32.893898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2bbef404-5168-4d67-be82-fca818d35d27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:32.895242 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2bbef404-5168-4d67-be82-fca818d35d27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:32.895242 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2bbef404-5168-4d67-be82-fca818d35d27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:32.895956 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2bbef404-5168-4d67-be82-fca818d35d27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:32.896525 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2bbef404-5168-4d67-be82-fca818d35d27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:32.897120 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2bbef404-5168-4d67-be82-fca818d35d27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:33.000860 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2578227a-f98b-4bac-8817-595cea158e48 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:33.009093 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-2578227a-f98b-4bac-8817-595cea158e48 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1315 microversion: 2.1 time: 0.261600 Aug 17 07:27:33.010111 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 56/106] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:32 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:33.088712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-2bbef404-5168-4d67-be82-fca818d35d27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:33.101202 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-2bbef404-5168-4d67-be82-fca818d35d27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:33.105693 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-2bbef404-5168-4d67-be82-fca818d35d27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:33.111694 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-2bbef404-5168-4d67-be82-fca818d35d27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1407 microversion: 2.20 time: 0.229127 Aug 17 07:27:33.113776 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 51/107] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:32 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:27:33.488725 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-fb4a37d3-71db-4c83-b638-11021aa142d3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:33.489268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-fb4a37d3-71db-4c83-b638-11021aa142d3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:33.496167 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fb4a37d3-71db-4c83-b638-11021aa142d3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:33.496719 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fb4a37d3-71db-4c83-b638-11021aa142d3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:33.497231 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fb4a37d3-71db-4c83-b638-11021aa142d3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:33.498028 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fb4a37d3-71db-4c83-b638-11021aa142d3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:33.498485 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fb4a37d3-71db-4c83-b638-11021aa142d3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:33.499112 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fb4a37d3-71db-4c83-b638-11021aa142d3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:33.533670 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-3c2825d6-987d-470b-b571-42aa9ad92d21 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:33.534308 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-3c2825d6-987d-470b-b571-42aa9ad92d21 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:33.549434 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3c2825d6-987d-470b-b571-42aa9ad92d21 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:33.550416 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3c2825d6-987d-470b-b571-42aa9ad92d21 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:33.551013 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3c2825d6-987d-470b-b571-42aa9ad92d21 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:33.551914 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3c2825d6-987d-470b-b571-42aa9ad92d21 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:33.552668 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3c2825d6-987d-470b-b571-42aa9ad92d21 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:33.553252 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3c2825d6-987d-470b-b571-42aa9ad92d21 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:33.892097 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-fb4a37d3-71db-4c83-b638-11021aa142d3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:33.903167 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-3c2825d6-987d-470b-b571-42aa9ad92d21 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:33.904964 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-fb4a37d3-71db-4c83-b638-11021aa142d3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1365 microversion: 2.1 time: 0.420265 Aug 17 07:27:33.907245 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 57/108] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:33 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1365 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:33.912980 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e26a793c-a509-4c73-9c31-0ea9db0063b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:33.914089 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e26a793c-a509-4c73-9c31-0ea9db0063b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:33.915958 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-3c2825d6-987d-470b-b571-42aa9ad92d21 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1364 microversion: 2.1 time: 0.386401 Aug 17 07:27:33.921814 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e26a793c-a509-4c73-9c31-0ea9db0063b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:33.923991 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e26a793c-a509-4c73-9c31-0ea9db0063b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:33.924648 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e26a793c-a509-4c73-9c31-0ea9db0063b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:33.925539 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e26a793c-a509-4c73-9c31-0ea9db0063b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:33.926097 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e26a793c-a509-4c73-9c31-0ea9db0063b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:33.926776 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e26a793c-a509-4c73-9c31-0ea9db0063b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:33.936039 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 52/109] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:33 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1364 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:34.037217 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ae2b697e-9406-41bb-9188-d9d8922394c9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:34.037664 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ae2b697e-9406-41bb-9188-d9d8922394c9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:34.050505 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ae2b697e-9406-41bb-9188-d9d8922394c9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:34.051006 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ae2b697e-9406-41bb-9188-d9d8922394c9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:34.053498 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ae2b697e-9406-41bb-9188-d9d8922394c9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:34.054751 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ae2b697e-9406-41bb-9188-d9d8922394c9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:34.058514 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ae2b697e-9406-41bb-9188-d9d8922394c9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:34.059472 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ae2b697e-9406-41bb-9188-d9d8922394c9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:34.169655 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-e26a793c-a509-4c73-9c31-0ea9db0063b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:34.187734 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e26a793c-a509-4c73-9c31-0ea9db0063b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1322 microversion: 2.1 time: 0.278223 Aug 17 07:27:34.188880 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 58/110] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:33 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:34.196612 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-46e53cb0-a21a-46af-a685-10542b00432c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:34.200912 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-46e53cb0-a21a-46af-a685-10542b00432c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:34.217810 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-46e53cb0-a21a-46af-a685-10542b00432c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:34.219860 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-46e53cb0-a21a-46af-a685-10542b00432c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:34.220622 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-46e53cb0-a21a-46af-a685-10542b00432c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:34.223681 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-46e53cb0-a21a-46af-a685-10542b00432c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:34.224424 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-46e53cb0-a21a-46af-a685-10542b00432c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:34.226032 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-46e53cb0-a21a-46af-a685-10542b00432c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:34.304042 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ae2b697e-9406-41bb-9188-d9d8922394c9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:34.312961 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ae2b697e-9406-41bb-9188-d9d8922394c9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1315 microversion: 2.1 time: 0.282989 Aug 17 07:27:34.315695 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 53/111] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:34 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:34.419931 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-46e53cb0-a21a-46af-a685-10542b00432c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:34.429574 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-46e53cb0-a21a-46af-a685-10542b00432c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:34.431664 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-46e53cb0-a21a-46af-a685-10542b00432c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:34.433072 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-46e53cb0-a21a-46af-a685-10542b00432c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1407 microversion: 2.20 time: 0.242996 Aug 17 07:27:34.434955 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 59/112] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:34 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:27:34.925416 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=6 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:34.931530 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a9e4d0e9-9091-4aac-86ba-6cbe4f862e56 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:34.932834 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-a9e4d0e9-9091-4aac-86ba-6cbe4f862e56 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:34.941375 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-efc43ffa-5d31-4b3b-a0c0-da5b69cff05f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:34.942126 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-efc43ffa-5d31-4b3b-a0c0-da5b69cff05f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:34.951505 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a9e4d0e9-9091-4aac-86ba-6cbe4f862e56 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:34.952229 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a9e4d0e9-9091-4aac-86ba-6cbe4f862e56 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:34.954553 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a9e4d0e9-9091-4aac-86ba-6cbe4f862e56 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:34.955285 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-efc43ffa-5d31-4b3b-a0c0-da5b69cff05f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:34.955653 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-efc43ffa-5d31-4b3b-a0c0-da5b69cff05f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:34.958009 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-efc43ffa-5d31-4b3b-a0c0-da5b69cff05f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:34.958009 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-efc43ffa-5d31-4b3b-a0c0-da5b69cff05f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:34.958009 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-efc43ffa-5d31-4b3b-a0c0-da5b69cff05f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:34.958009 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-efc43ffa-5d31-4b3b-a0c0-da5b69cff05f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:34.958738 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a9e4d0e9-9091-4aac-86ba-6cbe4f862e56 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:34.959302 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a9e4d0e9-9091-4aac-86ba-6cbe4f862e56 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:34.959750 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a9e4d0e9-9091-4aac-86ba-6cbe4f862e56 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:34.990599 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=10 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:35.199833 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a9e4d0e9-9091-4aac-86ba-6cbe4f862e56 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:35.213713 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a9e4d0e9-9091-4aac-86ba-6cbe4f862e56 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1365 microversion: 2.1 time: 0.289760 Aug 17 07:27:35.233911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 54/113] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:34 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:35.251226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f394fcb0-b10f-4199-a612-3d1b031ee77e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:35.255470 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f394fcb0-b10f-4199-a612-3d1b031ee77e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:35.263690 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-efc43ffa-5d31-4b3b-a0c0-da5b69cff05f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:35.264390 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f394fcb0-b10f-4199-a612-3d1b031ee77e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:35.265445 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f394fcb0-b10f-4199-a612-3d1b031ee77e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:35.266445 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f394fcb0-b10f-4199-a612-3d1b031ee77e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:35.267575 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f394fcb0-b10f-4199-a612-3d1b031ee77e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:35.268546 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f394fcb0-b10f-4199-a612-3d1b031ee77e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:35.269260 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f394fcb0-b10f-4199-a612-3d1b031ee77e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:35.273003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-efc43ffa-5d31-4b3b-a0c0-da5b69cff05f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1364 microversion: 2.1 time: 0.335994 Aug 17 07:27:35.274733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 60/114] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:34 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1364 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:27:35.340775 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ba2a88ca-1254-4c30-8364-488c2ab12797 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:35.341441 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-ba2a88ca-1254-4c30-8364-488c2ab12797 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:35.361883 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ba2a88ca-1254-4c30-8364-488c2ab12797 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:35.362414 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ba2a88ca-1254-4c30-8364-488c2ab12797 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:35.362856 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ba2a88ca-1254-4c30-8364-488c2ab12797 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:35.363857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ba2a88ca-1254-4c30-8364-488c2ab12797 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:35.364317 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ba2a88ca-1254-4c30-8364-488c2ab12797 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:35.364975 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ba2a88ca-1254-4c30-8364-488c2ab12797 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:35.447611 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f394fcb0-b10f-4199-a612-3d1b031ee77e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:35.457758 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f394fcb0-b10f-4199-a612-3d1b031ee77e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1322 microversion: 2.1 time: 0.221926 Aug 17 07:27:35.458717 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 55/115] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:35 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:35.464891 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-e48bb5eb-d760-42ce-ac73-652b98c18b90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:35.465711 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-e48bb5eb-d760-42ce-ac73-652b98c18b90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:35.473215 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e48bb5eb-d760-42ce-ac73-652b98c18b90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:35.474063 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e48bb5eb-d760-42ce-ac73-652b98c18b90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:35.474681 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e48bb5eb-d760-42ce-ac73-652b98c18b90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:35.476200 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e48bb5eb-d760-42ce-ac73-652b98c18b90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:35.476662 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e48bb5eb-d760-42ce-ac73-652b98c18b90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:35.477141 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e48bb5eb-d760-42ce-ac73-652b98c18b90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:35.525006 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=100 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:35.612645 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ba2a88ca-1254-4c30-8364-488c2ab12797 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:35.625459 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-ba2a88ca-1254-4c30-8364-488c2ab12797 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1315 microversion: 2.1 time: 0.292261 Aug 17 07:27:35.626270 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 61/116] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:35 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:35.689166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-e48bb5eb-d760-42ce-ac73-652b98c18b90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:35.699089 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-e48bb5eb-d760-42ce-ac73-652b98c18b90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:35.701063 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-e48bb5eb-d760-42ce-ac73-652b98c18b90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:35.703959 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-e48bb5eb-d760-42ce-ac73-652b98c18b90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1407 microversion: 2.20 time: 0.242725 Aug 17 07:27:35.705820 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 56/117] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:35 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:27:36.256647 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-f7197890-57cc-4427-8a03-c90f9edf5346 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:36.257365 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-f7197890-57cc-4427-8a03-c90f9edf5346 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:36.266298 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f7197890-57cc-4427-8a03-c90f9edf5346 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:36.266818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f7197890-57cc-4427-8a03-c90f9edf5346 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:36.267256 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f7197890-57cc-4427-8a03-c90f9edf5346 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:36.267952 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f7197890-57cc-4427-8a03-c90f9edf5346 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:36.268400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f7197890-57cc-4427-8a03-c90f9edf5346 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:36.268826 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f7197890-57cc-4427-8a03-c90f9edf5346 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:36.329115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-f8ecb0e6-b9c5-4416-8def-99017d2ca6b0 req-add0612c-6a36-4720-b2e6-9c61742fdbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebfec5b-68c1-41cd-910b-e73220fc2fd6", "name": "network-vif-plugged", "status": "completed", "tag": "dc7af87b-fe16-4334-a953-7e5e2d03e8e7"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:36.338561 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-f8ecb0e6-b9c5-4416-8def-99017d2ca6b0 req-add0612c-6a36-4720-b2e6-9c61742fdbb0 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:36.339042 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-f8ecb0e6-b9c5-4416-8def-99017d2ca6b0 req-add0612c-6a36-4720-b2e6-9c61742fdbb0 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:36.339466 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-f8ecb0e6-b9c5-4416-8def-99017d2ca6b0 req-add0612c-6a36-4720-b2e6-9c61742fdbb0 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:36.353042 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-f8ecb0e6-b9c5-4416-8def-99017d2ca6b0 req-add0612c-6a36-4720-b2e6-9c61742fdbb0 service nova] Creating event network-vif-plugged:dc7af87b-fe16-4334-a953-7e5e2d03e8e7 for instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 on hv-cinder-85312 Aug 17 07:27:36.358954 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-f8ecb0e6-b9c5-4416-8def-99017d2ca6b0 req-add0612c-6a36-4720-b2e6-9c61742fdbb0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101856 Aug 17 07:27:36.359587 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 57/118] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:27:36.364731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f5e062a7-3666-4207-841a-1fbd63c86423 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:36.366192 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f5e062a7-3666-4207-841a-1fbd63c86423 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:36.372998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f5e062a7-3666-4207-841a-1fbd63c86423 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:36.373494 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f5e062a7-3666-4207-841a-1fbd63c86423 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:36.373925 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f5e062a7-3666-4207-841a-1fbd63c86423 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:36.374654 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f5e062a7-3666-4207-841a-1fbd63c86423 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:36.375811 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f5e062a7-3666-4207-841a-1fbd63c86423 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:36.376245 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f5e062a7-3666-4207-841a-1fbd63c86423 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:36.432527 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-f7197890-57cc-4427-8a03-c90f9edf5346 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:36.442820 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-f7197890-57cc-4427-8a03-c90f9edf5346 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1365 microversion: 2.1 time: 0.190233 Aug 17 07:27:36.446287 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 62/119] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:36 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:36.482784 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-4c23ea85-fd6c-4b36-826b-90928aeaba8a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:36.483799 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-4c23ea85-fd6c-4b36-826b-90928aeaba8a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:36.491289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4c23ea85-fd6c-4b36-826b-90928aeaba8a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:36.492530 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4c23ea85-fd6c-4b36-826b-90928aeaba8a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:36.493349 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4c23ea85-fd6c-4b36-826b-90928aeaba8a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:36.495497 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4c23ea85-fd6c-4b36-826b-90928aeaba8a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:36.496207 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4c23ea85-fd6c-4b36-826b-90928aeaba8a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:36.497562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4c23ea85-fd6c-4b36-826b-90928aeaba8a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:36.505399 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=100 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:36.568303 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f5e062a7-3666-4207-841a-1fbd63c86423 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:36.584602 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f5e062a7-3666-4207-841a-1fbd63c86423 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1364 microversion: 2.1 time: 0.223536 Aug 17 07:27:36.587467 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 58/120] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:36 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:36.647726 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-487106cb-0e0f-4e53-b9de-c44b9c0c4d3c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:36.649878 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-487106cb-0e0f-4e53-b9de-c44b9c0c4d3c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:36.666798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-487106cb-0e0f-4e53-b9de-c44b9c0c4d3c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:36.669239 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-487106cb-0e0f-4e53-b9de-c44b9c0c4d3c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:36.670875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-487106cb-0e0f-4e53-b9de-c44b9c0c4d3c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:36.673065 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-487106cb-0e0f-4e53-b9de-c44b9c0c4d3c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:36.673822 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-487106cb-0e0f-4e53-b9de-c44b9c0c4d3c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:36.677132 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-487106cb-0e0f-4e53-b9de-c44b9c0c4d3c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:37.124402 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-4c23ea85-fd6c-4b36-826b-90928aeaba8a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:37.136754 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-4c23ea85-fd6c-4b36-826b-90928aeaba8a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1322 microversion: 2.1 time: 0.658125 Aug 17 07:27:37.137936 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 63/121] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:36 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1322 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:27:37.157374 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ae2fd91d-e496-4945-aef6-19493e6805cc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:37.158750 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-ae2fd91d-e496-4945-aef6-19493e6805cc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:37.169932 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ae2fd91d-e496-4945-aef6-19493e6805cc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:37.170991 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ae2fd91d-e496-4945-aef6-19493e6805cc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:37.171629 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ae2fd91d-e496-4945-aef6-19493e6805cc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:37.173214 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ae2fd91d-e496-4945-aef6-19493e6805cc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:37.173790 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ae2fd91d-e496-4945-aef6-19493e6805cc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:37.174360 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ae2fd91d-e496-4945-aef6-19493e6805cc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:37.206044 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-487106cb-0e0f-4e53-b9de-c44b9c0c4d3c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:37.215769 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-487106cb-0e0f-4e53-b9de-c44b9c0c4d3c tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1315 microversion: 2.1 time: 0.573883 Aug 17 07:27:37.216358 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 59/122] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:36 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:37.336171 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ae2fd91d-e496-4945-aef6-19493e6805cc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:37.349697 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ae2fd91d-e496-4945-aef6-19493e6805cc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:37.351543 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ae2fd91d-e496-4945-aef6-19493e6805cc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:37.353283 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-ae2fd91d-e496-4945-aef6-19493e6805cc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1407 microversion: 2.20 time: 0.214064 Aug 17 07:27:37.353972 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 64/123] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:37 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:27:37.466214 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-4999d80b-3fd2-429b-bfb0-5db4a95aa721 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:37.466804 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-4999d80b-3fd2-429b-bfb0-5db4a95aa721 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:37.473650 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4999d80b-3fd2-429b-bfb0-5db4a95aa721 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:37.474338 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4999d80b-3fd2-429b-bfb0-5db4a95aa721 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:37.474853 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4999d80b-3fd2-429b-bfb0-5db4a95aa721 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:37.475691 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4999d80b-3fd2-429b-bfb0-5db4a95aa721 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:37.476261 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4999d80b-3fd2-429b-bfb0-5db4a95aa721 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:37.476687 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4999d80b-3fd2-429b-bfb0-5db4a95aa721 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:37.607857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-1c3660ed-39af-4f55-8e66-5412b3d893f1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:37.608479 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-1c3660ed-39af-4f55-8e66-5412b3d893f1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:37.610223 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-4999d80b-3fd2-429b-bfb0-5db4a95aa721 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:37.615128 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1c3660ed-39af-4f55-8e66-5412b3d893f1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:37.615613 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1c3660ed-39af-4f55-8e66-5412b3d893f1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:37.616591 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1c3660ed-39af-4f55-8e66-5412b3d893f1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:37.617737 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1c3660ed-39af-4f55-8e66-5412b3d893f1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:37.618678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1c3660ed-39af-4f55-8e66-5412b3d893f1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:37.619113 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1c3660ed-39af-4f55-8e66-5412b3d893f1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:37.619329 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-4999d80b-3fd2-429b-bfb0-5db4a95aa721 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1365 microversion: 2.1 time: 0.157398 Aug 17 07:27:37.626519 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 60/124] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:37 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:37.750656 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-1c3660ed-39af-4f55-8e66-5412b3d893f1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:37.759370 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-1c3660ed-39af-4f55-8e66-5412b3d893f1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1364 microversion: 2.1 time: 0.154865 Aug 17 07:27:37.760019 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 65/125] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:37 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:27:38.158374 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-74dc3885-5c99-4206-811a-3aab3d6518c3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:38.159588 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-74dc3885-5c99-4206-811a-3aab3d6518c3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:38.167294 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-74dc3885-5c99-4206-811a-3aab3d6518c3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:38.168289 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-74dc3885-5c99-4206-811a-3aab3d6518c3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:38.168952 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-74dc3885-5c99-4206-811a-3aab3d6518c3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:38.170162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-74dc3885-5c99-4206-811a-3aab3d6518c3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:38.170881 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-74dc3885-5c99-4206-811a-3aab3d6518c3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:38.172520 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-74dc3885-5c99-4206-811a-3aab3d6518c3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:38.251992 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-efcf719d-2880-452c-afb0-36ed6504f89e tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:38.252887 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-efcf719d-2880-452c-afb0-36ed6504f89e tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:38.266500 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-efcf719d-2880-452c-afb0-36ed6504f89e tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:38.268340 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-efcf719d-2880-452c-afb0-36ed6504f89e tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:38.268789 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-efcf719d-2880-452c-afb0-36ed6504f89e tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:38.269649 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-efcf719d-2880-452c-afb0-36ed6504f89e tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:38.271469 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-efcf719d-2880-452c-afb0-36ed6504f89e tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:38.272729 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-efcf719d-2880-452c-afb0-36ed6504f89e tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:38.496463 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-74dc3885-5c99-4206-811a-3aab3d6518c3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:38.511209 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-74dc3885-5c99-4206-811a-3aab3d6518c3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1322 microversion: 2.1 time: 0.356777 Aug 17 07:27:38.512801 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 61/126] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:38 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:38.528659 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-efcf719d-2880-452c-afb0-36ed6504f89e tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:38.530542 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-301b7b1c-215a-4e3d-9c10-cd50248a009a req-5307a86f-1c68-4cb6-afff-4b5858bcf461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479d4f33-9d2a-4cec-84c9-18c739e2374f", "name": "network-vif-plugged", "status": "completed", "tag": "3605db22-3f80-4c4c-927b-ba43e6ba88ef"}, {"server_uuid": "b55345ed-b67a-4e85-aa91-a1351ca5fdf1", "name": "network-vif-plugged", "status": "completed", "tag": "1d23fdf6-efa9-43ab-a1df-ef927886dc2e"}, {"server_uuid": "bf0f55a4-d90a-443c-85c1-37216c95aa7a", "name": "network-vif-plugged", "status": "completed", "tag": "60c1b470-3d85-4b92-8000-58ca0fee2484"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:38.541925 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-efcf719d-2880-452c-afb0-36ed6504f89e tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1315 microversion: 2.1 time: 0.295072 Aug 17 07:27:38.543207 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 66/127] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:38 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:27:38.547905 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-301b7b1c-215a-4e3d-9c10-cd50248a009a req-5307a86f-1c68-4cb6-afff-4b5858bcf461 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:38.548613 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-301b7b1c-215a-4e3d-9c10-cd50248a009a req-5307a86f-1c68-4cb6-afff-4b5858bcf461 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:38.549318 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-301b7b1c-215a-4e3d-9c10-cd50248a009a req-5307a86f-1c68-4cb6-afff-4b5858bcf461 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:38.551906 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-6d2c6ee0-3a88-426c-851c-4d12705f28df tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:38.555796 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-6d2c6ee0-3a88-426c-851c-4d12705f28df tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:38.562492 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6d2c6ee0-3a88-426c-851c-4d12705f28df tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:38.563242 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6d2c6ee0-3a88-426c-851c-4d12705f28df tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:38.564695 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6d2c6ee0-3a88-426c-851c-4d12705f28df tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:38.565618 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6d2c6ee0-3a88-426c-851c-4d12705f28df tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:38.566308 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6d2c6ee0-3a88-426c-851c-4d12705f28df tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:38.566932 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6d2c6ee0-3a88-426c-851c-4d12705f28df tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:38.569363 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-301b7b1c-215a-4e3d-9c10-cd50248a009a req-5307a86f-1c68-4cb6-afff-4b5858bcf461 service nova] Creating event network-vif-plugged:3605db22-3f80-4c4c-927b-ba43e6ba88ef for instance 479d4f33-9d2a-4cec-84c9-18c739e2374f on hv-cinder-85312 Aug 17 07:27:38.569946 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-301b7b1c-215a-4e3d-9c10-cd50248a009a req-5307a86f-1c68-4cb6-afff-4b5858bcf461 service nova] Creating event network-vif-plugged:1d23fdf6-efa9-43ab-a1df-ef927886dc2e for instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 on hv-cinder-85312 Aug 17 07:27:38.570648 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-301b7b1c-215a-4e3d-9c10-cd50248a009a req-5307a86f-1c68-4cb6-afff-4b5858bcf461 service nova] Creating event network-vif-plugged:60c1b470-3d85-4b92-8000-58ca0fee2484 for instance bf0f55a4-d90a-443c-85c1-37216c95aa7a on hv-cinder-85312 Aug 17 07:27:38.583080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-301b7b1c-215a-4e3d-9c10-cd50248a009a req-5307a86f-1c68-4cb6-afff-4b5858bcf461 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.068386 Aug 17 07:27:38.583812 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 62/128] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:27:38.647804 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-da3e30a5-887d-4fa0-a681-df807995826d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:38.648795 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-da3e30a5-887d-4fa0-a681-df807995826d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:38.659100 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-da3e30a5-887d-4fa0-a681-df807995826d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:38.661808 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-da3e30a5-887d-4fa0-a681-df807995826d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:38.672062 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-da3e30a5-887d-4fa0-a681-df807995826d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:38.673123 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-da3e30a5-887d-4fa0-a681-df807995826d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:38.675170 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-da3e30a5-887d-4fa0-a681-df807995826d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:38.676479 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-da3e30a5-887d-4fa0-a681-df807995826d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:38.926610 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-6d2c6ee0-3a88-426c-851c-4d12705f28df tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:38.938532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-6d2c6ee0-3a88-426c-851c-4d12705f28df tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:38.941369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-6d2c6ee0-3a88-426c-851c-4d12705f28df tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:38.942884 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-6d2c6ee0-3a88-426c-851c-4d12705f28df tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1407 microversion: 2.20 time: 0.398484 Aug 17 07:27:38.943609 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 67/129] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:38 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:27:38.949271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-77b4e0dc-ce6f-4467-86ab-cba7adb1ea54 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:38.949954 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-77b4e0dc-ce6f-4467-86ab-cba7adb1ea54 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:38.962930 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-77b4e0dc-ce6f-4467-86ab-cba7adb1ea54 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:38.963629 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-77b4e0dc-ce6f-4467-86ab-cba7adb1ea54 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:38.964331 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-77b4e0dc-ce6f-4467-86ab-cba7adb1ea54 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:38.965115 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-77b4e0dc-ce6f-4467-86ab-cba7adb1ea54 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:38.965668 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-77b4e0dc-ce6f-4467-86ab-cba7adb1ea54 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:38.966193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-77b4e0dc-ce6f-4467-86ab-cba7adb1ea54 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:38.981053 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-da3e30a5-887d-4fa0-a681-df807995826d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:38.991466 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-da3e30a5-887d-4fa0-a681-df807995826d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1365 microversion: 2.1 time: 0.354272 Aug 17 07:27:38.993025 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 63/130] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:38 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:27:39.105599 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-77b4e0dc-ce6f-4467-86ab-cba7adb1ea54 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:39.113534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-77b4e0dc-ce6f-4467-86ab-cba7adb1ea54 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1364 microversion: 2.1 time: 0.168459 Aug 17 07:27:39.114119 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 68/131] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:38 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:39.534266 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-cb4cc76e-686a-4bcd-b547-ed13f02038d1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:39.534996 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-cb4cc76e-686a-4bcd-b547-ed13f02038d1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:39.541848 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cb4cc76e-686a-4bcd-b547-ed13f02038d1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:39.542350 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cb4cc76e-686a-4bcd-b547-ed13f02038d1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:39.542768 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cb4cc76e-686a-4bcd-b547-ed13f02038d1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:39.543783 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cb4cc76e-686a-4bcd-b547-ed13f02038d1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:39.544235 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cb4cc76e-686a-4bcd-b547-ed13f02038d1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:39.544825 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cb4cc76e-686a-4bcd-b547-ed13f02038d1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:39.563998 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-60eb361b-8c5e-4cdb-9fe7-32a3a7fdb524 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:39.564609 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-60eb361b-8c5e-4cdb-9fe7-32a3a7fdb524 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:39.571324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-60eb361b-8c5e-4cdb-9fe7-32a3a7fdb524 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:39.572113 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-60eb361b-8c5e-4cdb-9fe7-32a3a7fdb524 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:39.572779 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-60eb361b-8c5e-4cdb-9fe7-32a3a7fdb524 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:39.573686 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-60eb361b-8c5e-4cdb-9fe7-32a3a7fdb524 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:39.574361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-60eb361b-8c5e-4cdb-9fe7-32a3a7fdb524 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:39.574993 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-60eb361b-8c5e-4cdb-9fe7-32a3a7fdb524 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:39.817929 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-cb4cc76e-686a-4bcd-b547-ed13f02038d1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:39.826615 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-cb4cc76e-686a-4bcd-b547-ed13f02038d1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1322 microversion: 2.1 time: 0.297884 Aug 17 07:27:39.827191 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 64/132] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:39 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:39.835918 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-60eb361b-8c5e-4cdb-9fe7-32a3a7fdb524 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:39.847154 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-60eb361b-8c5e-4cdb-9fe7-32a3a7fdb524 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1315 microversion: 2.1 time: 0.286407 Aug 17 07:27:39.847958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 69/133] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:39 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:27:39.964625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-229a13b3-f03b-4b4e-8381-ff5de2b40cf9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:39.965226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-229a13b3-f03b-4b4e-8381-ff5de2b40cf9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:39.971237 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-229a13b3-f03b-4b4e-8381-ff5de2b40cf9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:39.971741 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-229a13b3-f03b-4b4e-8381-ff5de2b40cf9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:39.972223 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-229a13b3-f03b-4b4e-8381-ff5de2b40cf9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:39.972936 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-229a13b3-f03b-4b4e-8381-ff5de2b40cf9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:39.973389 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-229a13b3-f03b-4b4e-8381-ff5de2b40cf9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:39.973818 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-229a13b3-f03b-4b4e-8381-ff5de2b40cf9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:40.012529 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-5cafce52-4455-41ab-aa69-ab64bb542741 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:40.013138 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-5cafce52-4455-41ab-aa69-ab64bb542741 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:40.022560 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5cafce52-4455-41ab-aa69-ab64bb542741 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:40.022560 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5cafce52-4455-41ab-aa69-ab64bb542741 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:40.022560 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5cafce52-4455-41ab-aa69-ab64bb542741 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:40.022560 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5cafce52-4455-41ab-aa69-ab64bb542741 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:40.022891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5cafce52-4455-41ab-aa69-ab64bb542741 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:40.022891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5cafce52-4455-41ab-aa69-ab64bb542741 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:40.171280 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-229a13b3-f03b-4b4e-8381-ff5de2b40cf9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:40.180175 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-229a13b3-f03b-4b4e-8381-ff5de2b40cf9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:40.182050 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-229a13b3-f03b-4b4e-8381-ff5de2b40cf9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:40.183310 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-229a13b3-f03b-4b4e-8381-ff5de2b40cf9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1598 microversion: 2.20 time: 0.222621 Aug 17 07:27:40.183939 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 65/134] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:27:39 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1598 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:27:40.189389 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-68d848f1-d761-43c4-9ed3-3b816e7dd4c4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:40.190091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-68d848f1-d761-43c4-9ed3-3b816e7dd4c4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:40.196137 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-68d848f1-d761-43c4-9ed3-3b816e7dd4c4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:40.197483 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-68d848f1-d761-43c4-9ed3-3b816e7dd4c4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:40.198194 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-68d848f1-d761-43c4-9ed3-3b816e7dd4c4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:40.199216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-68d848f1-d761-43c4-9ed3-3b816e7dd4c4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:40.200013 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-68d848f1-d761-43c4-9ed3-3b816e7dd4c4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:40.200647 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-68d848f1-d761-43c4-9ed3-3b816e7dd4c4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:40.213688 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-5cafce52-4455-41ab-aa69-ab64bb542741 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:40.221297 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-5cafce52-4455-41ab-aa69-ab64bb542741 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1365 microversion: 2.1 time: 0.212498 Aug 17 07:27:40.221864 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 70/135] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:40 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:40.239300 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-796b98aa-3283-4c70-a789-e85de30811ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:40.239792 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-796b98aa-3283-4c70-a789-e85de30811ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:40.246012 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-796b98aa-3283-4c70-a789-e85de30811ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:40.246494 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-796b98aa-3283-4c70-a789-e85de30811ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:40.246931 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-796b98aa-3283-4c70-a789-e85de30811ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:40.247619 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-796b98aa-3283-4c70-a789-e85de30811ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:40.248066 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-796b98aa-3283-4c70-a789-e85de30811ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:40.248480 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-796b98aa-3283-4c70-a789-e85de30811ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:40.387671 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-68d848f1-d761-43c4-9ed3-3b816e7dd4c4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:40.394155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-796b98aa-3283-4c70-a789-e85de30811ae tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.158506 Aug 17 07:27:40.394982 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 71/136] 10.222.0.45 () {60 vars in 1316 bytes} [Wed Aug 17 07:27:40 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 07:27:40.399608 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-68d848f1-d761-43c4-9ed3-3b816e7dd4c4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1364 microversion: 2.1 time: 0.214219 Aug 17 07:27:40.400979 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 66/137] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:40 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:40.605383 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-34411b63-ac53-479c-97c5-30e894cd6e41 req-c41b0515-ae49-476d-84bd-4a0f1f1ce143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d1495a-563e-4c4f-ba8c-1fa046813a22", "name": "network-vif-plugged", "status": "completed", "tag": "4baae37f-d765-4b53-bd78-8bf3e3c5f440"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:40.626497 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-34411b63-ac53-479c-97c5-30e894cd6e41 req-c41b0515-ae49-476d-84bd-4a0f1f1ce143 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:40.627026 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-34411b63-ac53-479c-97c5-30e894cd6e41 req-c41b0515-ae49-476d-84bd-4a0f1f1ce143 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:40.628146 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-34411b63-ac53-479c-97c5-30e894cd6e41 req-c41b0515-ae49-476d-84bd-4a0f1f1ce143 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:40.639961 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-34411b63-ac53-479c-97c5-30e894cd6e41 req-c41b0515-ae49-476d-84bd-4a0f1f1ce143 service nova] Creating event network-vif-plugged:4baae37f-d765-4b53-bd78-8bf3e3c5f440 for instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 on hv-cinder-85312 Aug 17 07:27:40.645449 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-34411b63-ac53-479c-97c5-30e894cd6e41 req-c41b0515-ae49-476d-84bd-4a0f1f1ce143 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046100 Aug 17 07:27:40.646070 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 72/138] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:27:40.848517 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-479655e9-cea0-446b-a189-a157d4bdf361 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:40.849267 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-479655e9-cea0-446b-a189-a157d4bdf361 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:40.856331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-479655e9-cea0-446b-a189-a157d4bdf361 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:40.856951 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-479655e9-cea0-446b-a189-a157d4bdf361 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:40.857470 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-479655e9-cea0-446b-a189-a157d4bdf361 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:40.858390 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-479655e9-cea0-446b-a189-a157d4bdf361 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:40.858934 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-479655e9-cea0-446b-a189-a157d4bdf361 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:40.860056 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-479655e9-cea0-446b-a189-a157d4bdf361 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:40.871307 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-7f172fdf-4250-4f8b-9023-5f752139d469 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:40.872020 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-7f172fdf-4250-4f8b-9023-5f752139d469 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:40.879696 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7f172fdf-4250-4f8b-9023-5f752139d469 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:40.880226 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7f172fdf-4250-4f8b-9023-5f752139d469 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:40.880798 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7f172fdf-4250-4f8b-9023-5f752139d469 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:40.881667 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7f172fdf-4250-4f8b-9023-5f752139d469 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:40.882263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7f172fdf-4250-4f8b-9023-5f752139d469 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:40.882770 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7f172fdf-4250-4f8b-9023-5f752139d469 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:41.148766 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-479655e9-cea0-446b-a189-a157d4bdf361 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:41.151380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-7f172fdf-4250-4f8b-9023-5f752139d469 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:41.159979 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-479655e9-cea0-446b-a189-a157d4bdf361 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1322 microversion: 2.1 time: 0.316246 Aug 17 07:27:41.160987 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 67/139] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:40 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:41.161107 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-7f172fdf-4250-4f8b-9023-5f752139d469 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1502 microversion: 2.1 time: 0.296520 Aug 17 07:27:41.177614 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 73/140] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:40 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1502 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:27:41.242613 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-bb9dfe53-bf63-426a-8c9c-2e0385c7d4f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:41.243222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-bb9dfe53-bf63-426a-8c9c-2e0385c7d4f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:41.255794 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bb9dfe53-bf63-426a-8c9c-2e0385c7d4f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:41.256284 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bb9dfe53-bf63-426a-8c9c-2e0385c7d4f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:41.256712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bb9dfe53-bf63-426a-8c9c-2e0385c7d4f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:41.257880 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bb9dfe53-bf63-426a-8c9c-2e0385c7d4f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:41.258514 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bb9dfe53-bf63-426a-8c9c-2e0385c7d4f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:41.258941 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bb9dfe53-bf63-426a-8c9c-2e0385c7d4f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:41.423376 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-5dea5955-e79f-40b9-b5a7-43a0ac538ad8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:41.424046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-5dea5955-e79f-40b9-b5a7-43a0ac538ad8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:41.431414 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5dea5955-e79f-40b9-b5a7-43a0ac538ad8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:41.450430 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5dea5955-e79f-40b9-b5a7-43a0ac538ad8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:41.452898 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5dea5955-e79f-40b9-b5a7-43a0ac538ad8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:41.457033 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5dea5955-e79f-40b9-b5a7-43a0ac538ad8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:41.458566 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5dea5955-e79f-40b9-b5a7-43a0ac538ad8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:41.459023 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5dea5955-e79f-40b9-b5a7-43a0ac538ad8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:41.532248 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-bb9dfe53-bf63-426a-8c9c-2e0385c7d4f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:41.542641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-bb9dfe53-bf63-426a-8c9c-2e0385c7d4f2 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1365 microversion: 2.1 time: 0.303970 Aug 17 07:27:41.544112 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 68/141] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:41 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1365 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:41.687829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-5dea5955-e79f-40b9-b5a7-43a0ac538ad8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:41.696817 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-5dea5955-e79f-40b9-b5a7-43a0ac538ad8 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1364 microversion: 2.1 time: 0.278125 Aug 17 07:27:41.697786 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 74/142] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:41 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1364 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:42.064915 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-3486203e-d87a-48c4-95ac-18a16fc3978c req-ad81a9a9-899c-469f-9a87-7fd66168cd16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ebfec5b-68c1-41cd-910b-e73220fc2fd6", "tag": "dc7af87b-fe16-4334-a953-7e5e2d03e8e7"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:42.075302 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-3486203e-d87a-48c4-95ac-18a16fc3978c req-ad81a9a9-899c-469f-9a87-7fd66168cd16 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:42.075783 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-3486203e-d87a-48c4-95ac-18a16fc3978c req-ad81a9a9-899c-469f-9a87-7fd66168cd16 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:42.076230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-3486203e-d87a-48c4-95ac-18a16fc3978c req-ad81a9a9-899c-469f-9a87-7fd66168cd16 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:42.092399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-3486203e-d87a-48c4-95ac-18a16fc3978c req-ad81a9a9-899c-469f-9a87-7fd66168cd16 service nova] Creating event network-changed:dc7af87b-fe16-4334-a953-7e5e2d03e8e7 for instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 on hv-cinder-85312 Aug 17 07:27:42.099371 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-3486203e-d87a-48c4-95ac-18a16fc3978c req-ad81a9a9-899c-469f-9a87-7fd66168cd16 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038635 Aug 17 07:27:42.100584 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 69/143] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:27:42.180554 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-eaf3f36d-559b-4e77-8c9c-bc680996cbdc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:42.181251 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-eaf3f36d-559b-4e77-8c9c-bc680996cbdc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:42.187898 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eaf3f36d-559b-4e77-8c9c-bc680996cbdc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:42.188455 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eaf3f36d-559b-4e77-8c9c-bc680996cbdc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:42.188955 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eaf3f36d-559b-4e77-8c9c-bc680996cbdc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:42.189745 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eaf3f36d-559b-4e77-8c9c-bc680996cbdc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:42.190304 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eaf3f36d-559b-4e77-8c9c-bc680996cbdc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:42.190733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eaf3f36d-559b-4e77-8c9c-bc680996cbdc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:42.321441 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-eaf3f36d-559b-4e77-8c9c-bc680996cbdc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:42.329679 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-eaf3f36d-559b-4e77-8c9c-bc680996cbdc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1322 microversion: 2.1 time: 0.152894 Aug 17 07:27:42.330282 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 75/144] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:42 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:42.565465 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-271fe9ca-e45a-46ae-86f2-a3c32629727b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:42.566196 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-271fe9ca-e45a-46ae-86f2-a3c32629727b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:42.572584 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-271fe9ca-e45a-46ae-86f2-a3c32629727b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:42.573049 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-271fe9ca-e45a-46ae-86f2-a3c32629727b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:42.573473 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-271fe9ca-e45a-46ae-86f2-a3c32629727b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:42.574174 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-271fe9ca-e45a-46ae-86f2-a3c32629727b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:42.574614 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-271fe9ca-e45a-46ae-86f2-a3c32629727b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:42.575028 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-271fe9ca-e45a-46ae-86f2-a3c32629727b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:42.661588 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-998652ee-b3da-4979-8286-9367d7007af5 req-283593f2-acf8-4985-9f91-af3e58e4ad58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15365fa0-3501-49cd-a3d5-9ac53d13169f", "name": "network-vif-plugged", "status": "completed", "tag": "b2367014-b108-400d-a29f-670f07d2bad0"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:42.678248 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-998652ee-b3da-4979-8286-9367d7007af5 req-283593f2-acf8-4985-9f91-af3e58e4ad58 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:42.678945 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-998652ee-b3da-4979-8286-9367d7007af5 req-283593f2-acf8-4985-9f91-af3e58e4ad58 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:42.680319 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-998652ee-b3da-4979-8286-9367d7007af5 req-283593f2-acf8-4985-9f91-af3e58e4ad58 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:42.694032 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-998652ee-b3da-4979-8286-9367d7007af5 req-283593f2-acf8-4985-9f91-af3e58e4ad58 service nova] Creating event network-vif-plugged:b2367014-b108-400d-a29f-670f07d2bad0 for instance 15365fa0-3501-49cd-a3d5-9ac53d13169f on hv-cinder-85312 Aug 17 07:27:42.698955 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-998652ee-b3da-4979-8286-9367d7007af5 req-283593f2-acf8-4985-9f91-af3e58e4ad58 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040913 Aug 17 07:27:42.699883 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 76/145] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:27:42.718139 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-33f53a59-5320-4c3d-8062-4b024d53bb47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:42.719200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-33f53a59-5320-4c3d-8062-4b024d53bb47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:42.726325 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-33f53a59-5320-4c3d-8062-4b024d53bb47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:42.727659 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-33f53a59-5320-4c3d-8062-4b024d53bb47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:42.728295 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-33f53a59-5320-4c3d-8062-4b024d53bb47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:42.729206 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-33f53a59-5320-4c3d-8062-4b024d53bb47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:42.729845 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-33f53a59-5320-4c3d-8062-4b024d53bb47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:42.730474 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-33f53a59-5320-4c3d-8062-4b024d53bb47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:42.731512 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-271fe9ca-e45a-46ae-86f2-a3c32629727b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:42.745406 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-271fe9ca-e45a-46ae-86f2-a3c32629727b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1365 microversion: 2.1 time: 0.184692 Aug 17 07:27:42.747101 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 70/146] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:42 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:42.907895 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-4d066565-8691-4ad2-8789-43c8eba34d69 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68e753c5-4c78-4fac-9c98-c98833d6e1f6"}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:42.910199 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-4d066565-8691-4ad2-8789-43c8eba34d69 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:42.925953 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4d066565-8691-4ad2-8789-43c8eba34d69 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:42.926684 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4d066565-8691-4ad2-8789-43c8eba34d69 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:42.927293 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4d066565-8691-4ad2-8789-43c8eba34d69 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:42.928163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4d066565-8691-4ad2-8789-43c8eba34d69 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:42.928990 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4d066565-8691-4ad2-8789-43c8eba34d69 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:42.929552 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4d066565-8691-4ad2-8789-43c8eba34d69 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:42.937528 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-33f53a59-5320-4c3d-8062-4b024d53bb47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:42.948134 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-33f53a59-5320-4c3d-8062-4b024d53bb47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1364 microversion: 2.1 time: 0.233737 Aug 17 07:27:42.963150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 77/147] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:42 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:27:43.359562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-57c504ab-18c2-4931-b538-1b5f39360e81 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:43.360605 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-57c504ab-18c2-4931-b538-1b5f39360e81 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:43.374462 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57c504ab-18c2-4931-b538-1b5f39360e81 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:43.375252 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57c504ab-18c2-4931-b538-1b5f39360e81 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:43.376473 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57c504ab-18c2-4931-b538-1b5f39360e81 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:43.378423 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57c504ab-18c2-4931-b538-1b5f39360e81 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:43.379080 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57c504ab-18c2-4931-b538-1b5f39360e81 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:43.379722 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57c504ab-18c2-4931-b538-1b5f39360e81 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:43.564106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-57c504ab-18c2-4931-b538-1b5f39360e81 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:43.575276 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-57c504ab-18c2-4931-b538-1b5f39360e81 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1517 microversion: 2.1 time: 0.221998 Aug 17 07:27:43.579276 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 78/148] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:43 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1517 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:43.600273 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b6f63211-cf95-4c21-b9ca-f0e161d21e2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:43.602729 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-b6f63211-cf95-4c21-b9ca-f0e161d21e2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:43.609788 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b6f63211-cf95-4c21-b9ca-f0e161d21e2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:43.610468 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b6f63211-cf95-4c21-b9ca-f0e161d21e2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:43.611090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b6f63211-cf95-4c21-b9ca-f0e161d21e2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:43.611967 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b6f63211-cf95-4c21-b9ca-f0e161d21e2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:43.612589 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b6f63211-cf95-4c21-b9ca-f0e161d21e2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:43.613213 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b6f63211-cf95-4c21-b9ca-f0e161d21e2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:43.638163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-4d066565-8691-4ad2-8789-43c8eba34d69 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "POST /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.734541 Aug 17 07:27:43.639130 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 71/149] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 17 07:27:42 2022] POST /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1/os-volume_attachments => generated 194 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:27:43.639841 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.objects.instance [None req-b6f63211-cf95-4c21-b9ca-f0e161d21e2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lazy-loading 'flavor' on Instance uuid bf0f55a4-d90a-443c-85c1-37216c95aa7a {{(pid=120835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:27:43.742944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:43.768349 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-e0b78ef2-6cca-44d1-8e29-5df837f30dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:43.769035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-e0b78ef2-6cca-44d1-8e29-5df837f30dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:43.775459 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e0b78ef2-6cca-44d1-8e29-5df837f30dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:43.775924 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e0b78ef2-6cca-44d1-8e29-5df837f30dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:43.776350 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e0b78ef2-6cca-44d1-8e29-5df837f30dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:43.777028 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e0b78ef2-6cca-44d1-8e29-5df837f30dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:43.777532 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e0b78ef2-6cca-44d1-8e29-5df837f30dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:43.777948 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e0b78ef2-6cca-44d1-8e29-5df837f30dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:43.778321 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b6f63211-cf95-4c21-b9ca-f0e161d21e2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "POST /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a/action" status: 200 len: 32 microversion: 2.1 time: 0.181954 Aug 17 07:27:43.778932 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 79/150] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 17 07:27:43 2022] POST /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 17 07:27:43.788717 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-670e11cc-d988-4314-a13c-5e93f09ce1c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:43.789422 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-670e11cc-d988-4314-a13c-5e93f09ce1c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:43.795712 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-670e11cc-d988-4314-a13c-5e93f09ce1c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:43.796189 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-670e11cc-d988-4314-a13c-5e93f09ce1c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:43.796653 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-670e11cc-d988-4314-a13c-5e93f09ce1c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:43.797348 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-670e11cc-d988-4314-a13c-5e93f09ce1c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:43.797801 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-670e11cc-d988-4314-a13c-5e93f09ce1c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:43.799842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-670e11cc-d988-4314-a13c-5e93f09ce1c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:43.987432 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-e0b78ef2-6cca-44d1-8e29-5df837f30dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:43.989787 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-670e11cc-d988-4314-a13c-5e93f09ce1c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:43.995827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-e0b78ef2-6cca-44d1-8e29-5df837f30dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1365 microversion: 2.1 time: 0.232697 Aug 17 07:27:43.996720 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 72/151] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:43 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:27:44.001745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-21afd4ae-467c-485f-9ca7-212e4787b7a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:44.002375 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-21afd4ae-467c-485f-9ca7-212e4787b7a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:44.004849 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-670e11cc-d988-4314-a13c-5e93f09ce1c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.220271 Aug 17 07:27:44.005578 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 80/152] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:43 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:44.008139 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-21afd4ae-467c-485f-9ca7-212e4787b7a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:44.008617 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-21afd4ae-467c-485f-9ca7-212e4787b7a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:44.009051 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-21afd4ae-467c-485f-9ca7-212e4787b7a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:44.009737 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-21afd4ae-467c-485f-9ca7-212e4787b7a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:44.010220 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-21afd4ae-467c-485f-9ca7-212e4787b7a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:44.010645 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-21afd4ae-467c-485f-9ca7-212e4787b7a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:44.142547 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-21afd4ae-467c-485f-9ca7-212e4787b7a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:44.148147 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:44.150914 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-21afd4ae-467c-485f-9ca7-212e4787b7a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1364 microversion: 2.1 time: 0.153246 Aug 17 07:27:44.151479 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 73/153] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:43 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:45.026545 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-383fb0d9-8236-4254-a75d-7b547eb61fb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:45.027045 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c699dc6b-b1b2-43b5-a5e8-75648f9b121e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:45.027414 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-383fb0d9-8236-4254-a75d-7b547eb61fb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:45.027526 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c699dc6b-b1b2-43b5-a5e8-75648f9b121e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:45.034067 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-383fb0d9-8236-4254-a75d-7b547eb61fb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:45.034554 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-383fb0d9-8236-4254-a75d-7b547eb61fb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:45.034989 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-383fb0d9-8236-4254-a75d-7b547eb61fb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:45.035205 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c699dc6b-b1b2-43b5-a5e8-75648f9b121e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:45.035688 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c699dc6b-b1b2-43b5-a5e8-75648f9b121e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:45.035801 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-383fb0d9-8236-4254-a75d-7b547eb61fb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:45.036123 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c699dc6b-b1b2-43b5-a5e8-75648f9b121e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:45.036223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-383fb0d9-8236-4254-a75d-7b547eb61fb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:45.036549 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-383fb0d9-8236-4254-a75d-7b547eb61fb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:45.036797 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c699dc6b-b1b2-43b5-a5e8-75648f9b121e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:45.037247 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c699dc6b-b1b2-43b5-a5e8-75648f9b121e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:45.037667 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c699dc6b-b1b2-43b5-a5e8-75648f9b121e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:45.231921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-383fb0d9-8236-4254-a75d-7b547eb61fb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:45.240668 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c699dc6b-b1b2-43b5-a5e8-75648f9b121e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:45.241569 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-383fb0d9-8236-4254-a75d-7b547eb61fb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.218965 Aug 17 07:27:45.242823 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 81/154] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:45 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:45.247662 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-95fea2dd-3ba2-4abe-ad69-c11509f23a75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:45.248030 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-95fea2dd-3ba2-4abe-ad69-c11509f23a75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:45.257656 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-95fea2dd-3ba2-4abe-ad69-c11509f23a75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:45.258196 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-95fea2dd-3ba2-4abe-ad69-c11509f23a75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:45.258636 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-95fea2dd-3ba2-4abe-ad69-c11509f23a75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:45.259348 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-95fea2dd-3ba2-4abe-ad69-c11509f23a75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:45.259816 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-95fea2dd-3ba2-4abe-ad69-c11509f23a75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:45.260243 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-95fea2dd-3ba2-4abe-ad69-c11509f23a75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:45.265085 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c699dc6b-b1b2-43b5-a5e8-75648f9b121e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1365 microversion: 2.1 time: 0.242484 Aug 17 07:27:45.266281 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 74/155] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:45 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:45.406295 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-95fea2dd-3ba2-4abe-ad69-c11509f23a75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:45.414109 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-95fea2dd-3ba2-4abe-ad69-c11509f23a75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1549 microversion: 2.1 time: 0.170165 Aug 17 07:27:45.414689 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 82/156] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:45 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:45.435560 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c28c396a-9192-4cfc-b00a-6061836039f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:45.436184 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c28c396a-9192-4cfc-b00a-6061836039f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:45.442735 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c28c396a-9192-4cfc-b00a-6061836039f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:45.443394 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c28c396a-9192-4cfc-b00a-6061836039f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:45.443990 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c28c396a-9192-4cfc-b00a-6061836039f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:45.444673 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c28c396a-9192-4cfc-b00a-6061836039f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:45.445172 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c28c396a-9192-4cfc-b00a-6061836039f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:45.445515 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c28c396a-9192-4cfc-b00a-6061836039f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:45.528902 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c28c396a-9192-4cfc-b00a-6061836039f7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097510 Aug 17 07:27:45.534208 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 75/157] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 17 07:27:45 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:27:46.263860 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-37ba0907-0951-4c3e-8ab5-ecd244382144 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:46.264470 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-37ba0907-0951-4c3e-8ab5-ecd244382144 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:46.271824 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-37ba0907-0951-4c3e-8ab5-ecd244382144 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:46.272355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-37ba0907-0951-4c3e-8ab5-ecd244382144 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:46.272880 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-37ba0907-0951-4c3e-8ab5-ecd244382144 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:46.273616 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-37ba0907-0951-4c3e-8ab5-ecd244382144 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:46.274275 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-37ba0907-0951-4c3e-8ab5-ecd244382144 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:46.274703 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-37ba0907-0951-4c3e-8ab5-ecd244382144 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:46.287395 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9dc8c338-aea0-43d9-bd1b-eedd8a33bbed tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:46.288640 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9dc8c338-aea0-43d9-bd1b-eedd8a33bbed tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:46.299465 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9dc8c338-aea0-43d9-bd1b-eedd8a33bbed tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:46.307077 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9dc8c338-aea0-43d9-bd1b-eedd8a33bbed tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:46.308242 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9dc8c338-aea0-43d9-bd1b-eedd8a33bbed tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:46.309670 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9dc8c338-aea0-43d9-bd1b-eedd8a33bbed tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:46.311905 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9dc8c338-aea0-43d9-bd1b-eedd8a33bbed tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:46.313415 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9dc8c338-aea0-43d9-bd1b-eedd8a33bbed tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:46.545346 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-37ba0907-0951-4c3e-8ab5-ecd244382144 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:46.549313 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-9dc8c338-aea0-43d9-bd1b-eedd8a33bbed tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:46.553660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-37ba0907-0951-4c3e-8ab5-ecd244382144 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.293730 Aug 17 07:27:46.554461 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 83/158] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:46 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:46.557496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9dc8c338-aea0-43d9-bd1b-eedd8a33bbed tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1555 microversion: 2.1 time: 0.274733 Aug 17 07:27:46.558215 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 76/159] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:46 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1555 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:46.580181 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-45dab74d-e573-4212-90aa-9a17aa7797c1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:46.580795 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-45dab74d-e573-4212-90aa-9a17aa7797c1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:46.587939 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-45dab74d-e573-4212-90aa-9a17aa7797c1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:46.587939 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-45dab74d-e573-4212-90aa-9a17aa7797c1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:46.588305 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-45dab74d-e573-4212-90aa-9a17aa7797c1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:46.589166 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-45dab74d-e573-4212-90aa-9a17aa7797c1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:46.590397 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-45dab74d-e573-4212-90aa-9a17aa7797c1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:46.590603 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-45dab74d-e573-4212-90aa-9a17aa7797c1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:46.677225 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-45dab74d-e573-4212-90aa-9a17aa7797c1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102818 Aug 17 07:27:46.677899 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 84/160] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 17 07:27:46 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:27:47.085343 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-681088ef-b74c-4173-b50f-a18573bd0e4c req-7c8cbd8c-ea57-4c78-ab58-8308ca89f6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d1495a-563e-4c4f-ba8c-1fa046813a22", "tag": "4baae37f-d765-4b53-bd78-8bf3e3c5f440"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:47.104749 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-681088ef-b74c-4173-b50f-a18573bd0e4c req-7c8cbd8c-ea57-4c78-ab58-8308ca89f6c5 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:47.105301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-681088ef-b74c-4173-b50f-a18573bd0e4c req-7c8cbd8c-ea57-4c78-ab58-8308ca89f6c5 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:47.105796 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-681088ef-b74c-4173-b50f-a18573bd0e4c req-7c8cbd8c-ea57-4c78-ab58-8308ca89f6c5 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:47.126952 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-681088ef-b74c-4173-b50f-a18573bd0e4c req-7c8cbd8c-ea57-4c78-ab58-8308ca89f6c5 service nova] Creating event network-changed:4baae37f-d765-4b53-bd78-8bf3e3c5f440 for instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 on hv-cinder-85312 Aug 17 07:27:47.132490 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-681088ef-b74c-4173-b50f-a18573bd0e4c req-7c8cbd8c-ea57-4c78-ab58-8308ca89f6c5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050846 Aug 17 07:27:47.137909 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 77/161] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:27:47.575180 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ef75822f-ed26-4a3d-9927-4cb230bdf5be tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:47.575764 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-ef75822f-ed26-4a3d-9927-4cb230bdf5be tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:47.591988 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef75822f-ed26-4a3d-9927-4cb230bdf5be tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:47.594899 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef75822f-ed26-4a3d-9927-4cb230bdf5be tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:47.595597 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef75822f-ed26-4a3d-9927-4cb230bdf5be tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:47.596553 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef75822f-ed26-4a3d-9927-4cb230bdf5be tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:47.607803 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef75822f-ed26-4a3d-9927-4cb230bdf5be tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:47.609899 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef75822f-ed26-4a3d-9927-4cb230bdf5be tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:48.041263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ef75822f-ed26-4a3d-9927-4cb230bdf5be tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:48.051312 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-ef75822f-ed26-4a3d-9927-4cb230bdf5be tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.481208 Aug 17 07:27:48.052153 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 85/162] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:47 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:48.434736 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-9fcc5512-ee78-4e79-a5aa-b6851dc4386b req-1b48798f-c8d7-467a-ae7b-96b579aa86d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15365fa0-3501-49cd-a3d5-9ac53d13169f", "tag": "b2367014-b108-400d-a29f-670f07d2bad0"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:27:48.465860 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-9fcc5512-ee78-4e79-a5aa-b6851dc4386b req-1b48798f-c8d7-467a-ae7b-96b579aa86d9 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:48.466358 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-9fcc5512-ee78-4e79-a5aa-b6851dc4386b req-1b48798f-c8d7-467a-ae7b-96b579aa86d9 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:48.466960 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-9fcc5512-ee78-4e79-a5aa-b6851dc4386b req-1b48798f-c8d7-467a-ae7b-96b579aa86d9 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:48.480664 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-9fcc5512-ee78-4e79-a5aa-b6851dc4386b req-1b48798f-c8d7-467a-ae7b-96b579aa86d9 service nova] Creating event network-changed:b2367014-b108-400d-a29f-670f07d2bad0 for instance 15365fa0-3501-49cd-a3d5-9ac53d13169f on hv-cinder-85312 Aug 17 07:27:48.485654 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-9fcc5512-ee78-4e79-a5aa-b6851dc4386b req-1b48798f-c8d7-467a-ae7b-96b579aa86d9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055394 Aug 17 07:27:48.486722 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 78/163] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:27:49.074521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-0bba351c-5b74-4b9f-8080-29afaa2b92ba tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:49.075768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-0bba351c-5b74-4b9f-8080-29afaa2b92ba tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:49.085679 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0bba351c-5b74-4b9f-8080-29afaa2b92ba tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:49.088837 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0bba351c-5b74-4b9f-8080-29afaa2b92ba tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:49.089444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0bba351c-5b74-4b9f-8080-29afaa2b92ba tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:49.090343 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0bba351c-5b74-4b9f-8080-29afaa2b92ba tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:49.092534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0bba351c-5b74-4b9f-8080-29afaa2b92ba tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:49.093142 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0bba351c-5b74-4b9f-8080-29afaa2b92ba tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:49.302746 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-0bba351c-5b74-4b9f-8080-29afaa2b92ba tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:49.313730 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-0bba351c-5b74-4b9f-8080-29afaa2b92ba tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.243413 Aug 17 07:27:49.315161 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 86/164] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:49 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:27:50.337926 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-014f09c4-e00b-478d-9b68-5fafef679a6d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:50.338636 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-014f09c4-e00b-478d-9b68-5fafef679a6d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:50.347255 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-014f09c4-e00b-478d-9b68-5fafef679a6d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:50.347917 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-014f09c4-e00b-478d-9b68-5fafef679a6d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:50.348348 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-014f09c4-e00b-478d-9b68-5fafef679a6d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:50.351867 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-014f09c4-e00b-478d-9b68-5fafef679a6d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:50.351867 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-014f09c4-e00b-478d-9b68-5fafef679a6d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:50.351867 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-014f09c4-e00b-478d-9b68-5fafef679a6d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:50.497702 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-014f09c4-e00b-478d-9b68-5fafef679a6d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:50.505596 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-014f09c4-e00b-478d-9b68-5fafef679a6d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.172741 Aug 17 07:27:50.506186 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 79/165] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:50 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:51.526723 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e9c92242-44d4-46e6-85a8-8a0d0f988633 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:51.527456 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e9c92242-44d4-46e6-85a8-8a0d0f988633 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:51.534621 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e9c92242-44d4-46e6-85a8-8a0d0f988633 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:51.535096 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e9c92242-44d4-46e6-85a8-8a0d0f988633 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:51.535523 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e9c92242-44d4-46e6-85a8-8a0d0f988633 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:51.536210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e9c92242-44d4-46e6-85a8-8a0d0f988633 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:51.536653 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e9c92242-44d4-46e6-85a8-8a0d0f988633 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:51.542701 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e9c92242-44d4-46e6-85a8-8a0d0f988633 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:51.696951 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-e9c92242-44d4-46e6-85a8-8a0d0f988633 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:51.704864 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e9c92242-44d4-46e6-85a8-8a0d0f988633 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.181951 Aug 17 07:27:51.705444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 87/166] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:51 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:52.725856 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-2a445707-97c6-4655-80a4-cfeed841cd2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:52.726495 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-2a445707-97c6-4655-80a4-cfeed841cd2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:52.728971 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=95 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:52.734497 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2a445707-97c6-4655-80a4-cfeed841cd2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:52.735153 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2a445707-97c6-4655-80a4-cfeed841cd2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:52.735584 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2a445707-97c6-4655-80a4-cfeed841cd2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:52.736276 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2a445707-97c6-4655-80a4-cfeed841cd2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:52.736723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2a445707-97c6-4655-80a4-cfeed841cd2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:52.737143 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2a445707-97c6-4655-80a4-cfeed841cd2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:52.929273 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-2a445707-97c6-4655-80a4-cfeed841cd2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:52.936672 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-2a445707-97c6-4655-80a4-cfeed841cd2b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.214659 Aug 17 07:27:52.937814 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 80/167] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:52 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:53.959163 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-0f669656-2325-4f2d-a17c-71ce2ed1a5ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:53.959933 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-0f669656-2325-4f2d-a17c-71ce2ed1a5ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:53.963004 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=100 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:53.969063 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0f669656-2325-4f2d-a17c-71ce2ed1a5ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:53.969621 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0f669656-2325-4f2d-a17c-71ce2ed1a5ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:53.970230 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0f669656-2325-4f2d-a17c-71ce2ed1a5ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:53.970991 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0f669656-2325-4f2d-a17c-71ce2ed1a5ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:53.972152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0f669656-2325-4f2d-a17c-71ce2ed1a5ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:53.972152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0f669656-2325-4f2d-a17c-71ce2ed1a5ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:54.110345 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-0f669656-2325-4f2d-a17c-71ce2ed1a5ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:54.118468 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-0f669656-2325-4f2d-a17c-71ce2ed1a5ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.163794 Aug 17 07:27:54.119253 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 88/168] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:53 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:55.141156 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-17bd552a-8873-4532-a6e5-dab28922f79e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:55.142713 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-17bd552a-8873-4532-a6e5-dab28922f79e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:55.149338 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-17bd552a-8873-4532-a6e5-dab28922f79e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:55.149813 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-17bd552a-8873-4532-a6e5-dab28922f79e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:55.150841 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-17bd552a-8873-4532-a6e5-dab28922f79e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:55.151880 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-17bd552a-8873-4532-a6e5-dab28922f79e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:55.152462 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-17bd552a-8873-4532-a6e5-dab28922f79e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:55.153117 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-17bd552a-8873-4532-a6e5-dab28922f79e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:55.306933 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-17bd552a-8873-4532-a6e5-dab28922f79e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:55.315846 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-17bd552a-8873-4532-a6e5-dab28922f79e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.179215 Aug 17 07:27:55.316653 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 81/169] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:55 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:56.338848 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-bce342f3-7f00-4539-b55e-758eb96a988a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:56.339444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-bce342f3-7f00-4539-b55e-758eb96a988a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:56.346255 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bce342f3-7f00-4539-b55e-758eb96a988a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:56.346744 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bce342f3-7f00-4539-b55e-758eb96a988a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:56.347180 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bce342f3-7f00-4539-b55e-758eb96a988a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:56.347882 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bce342f3-7f00-4539-b55e-758eb96a988a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:56.348361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bce342f3-7f00-4539-b55e-758eb96a988a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:56.348980 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bce342f3-7f00-4539-b55e-758eb96a988a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:56.509081 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-bce342f3-7f00-4539-b55e-758eb96a988a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:56.517986 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-bce342f3-7f00-4539-b55e-758eb96a988a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.185154 Aug 17 07:27:56.518623 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 89/170] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:56 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:57.538739 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-86351cad-2047-4d52-82bc-276c994416f5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:57.539334 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-86351cad-2047-4d52-82bc-276c994416f5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:57.546709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-86351cad-2047-4d52-82bc-276c994416f5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:57.547196 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-86351cad-2047-4d52-82bc-276c994416f5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:57.547624 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-86351cad-2047-4d52-82bc-276c994416f5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:57.548306 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-86351cad-2047-4d52-82bc-276c994416f5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:57.548748 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-86351cad-2047-4d52-82bc-276c994416f5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:57.549162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-86351cad-2047-4d52-82bc-276c994416f5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:57.683267 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-86351cad-2047-4d52-82bc-276c994416f5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:57.690874 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-86351cad-2047-4d52-82bc-276c994416f5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.155978 Aug 17 07:27:57.691435 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 82/171] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:57 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:58.714445 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e85912fb-961d-4fff-86fb-86caf7c8c75e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:58.715818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e85912fb-961d-4fff-86fb-86caf7c8c75e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:58.722389 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e85912fb-961d-4fff-86fb-86caf7c8c75e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:58.722906 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e85912fb-961d-4fff-86fb-86caf7c8c75e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:58.723516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e85912fb-961d-4fff-86fb-86caf7c8c75e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:58.724218 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e85912fb-961d-4fff-86fb-86caf7c8c75e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:58.724674 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e85912fb-961d-4fff-86fb-86caf7c8c75e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:58.725125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e85912fb-961d-4fff-86fb-86caf7c8c75e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:58.809983 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0ea23205-7f88-4b40-8a90-9fc6270e36f4 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:58.810517 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0ea23205-7f88-4b40-8a90-9fc6270e36f4 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:58.817013 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0ea23205-7f88-4b40-8a90-9fc6270e36f4 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:58.817724 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0ea23205-7f88-4b40-8a90-9fc6270e36f4 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:58.818177 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0ea23205-7f88-4b40-8a90-9fc6270e36f4 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:58.819008 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0ea23205-7f88-4b40-8a90-9fc6270e36f4 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:58.819607 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0ea23205-7f88-4b40-8a90-9fc6270e36f4 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:58.820028 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0ea23205-7f88-4b40-8a90-9fc6270e36f4 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:58.849829 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0ea23205-7f88-4b40-8a90-9fc6270e36f4 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Going to try to terminate instance {{(pid=120834) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:27:58.933597 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-e85912fb-961d-4fff-86fb-86caf7c8c75e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:58.943368 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e85912fb-961d-4fff-86fb-86caf7c8c75e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.234591 Aug 17 07:27:58.944031 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 90/172] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:58 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:59.009704 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0ea23205-7f88-4b40-8a90-9fc6270e36f4 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 204 len: 0 microversion: 2.1 time: 0.203189 Aug 17 07:27:59.010336 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 83/173] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:27:58 2022] DELETE /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 07:27:59.019558 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-fcfbd5fd-3a08-4b27-b8f1-97d8d99674b9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:59.020421 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-fcfbd5fd-3a08-4b27-b8f1-97d8d99674b9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:59.027058 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fcfbd5fd-3a08-4b27-b8f1-97d8d99674b9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:59.027775 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fcfbd5fd-3a08-4b27-b8f1-97d8d99674b9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:59.028570 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fcfbd5fd-3a08-4b27-b8f1-97d8d99674b9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:59.029446 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fcfbd5fd-3a08-4b27-b8f1-97d8d99674b9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:59.029904 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fcfbd5fd-3a08-4b27-b8f1-97d8d99674b9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:59.030558 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fcfbd5fd-3a08-4b27-b8f1-97d8d99674b9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:59.177106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-fcfbd5fd-3a08-4b27-b8f1-97d8d99674b9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:27:59.185635 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-fcfbd5fd-3a08-4b27-b8f1-97d8d99674b9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1554 microversion: 2.1 time: 0.170880 Aug 17 07:27:59.186244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 91/174] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:59 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:27:59.968725 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-e915bd43-b017-4d68-a072-94c2f540eb44 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:27:59.969537 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-e915bd43-b017-4d68-a072-94c2f540eb44 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:27:59.976541 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e915bd43-b017-4d68-a072-94c2f540eb44 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:59.977115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e915bd43-b017-4d68-a072-94c2f540eb44 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:59.977639 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e915bd43-b017-4d68-a072-94c2f540eb44 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:27:59.978366 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e915bd43-b017-4d68-a072-94c2f540eb44 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:27:59.978824 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e915bd43-b017-4d68-a072-94c2f540eb44 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:27:59.979263 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e915bd43-b017-4d68-a072-94c2f540eb44 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:00.147967 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-e915bd43-b017-4d68-a072-94c2f540eb44 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:00.157297 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-e915bd43-b017-4d68-a072-94c2f540eb44 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.193985 Aug 17 07:28:00.157879 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 84/175] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:27:59 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:00.207181 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b3009a09-7e9d-4238-bdea-3c9df0fe5411 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:00.207714 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-b3009a09-7e9d-4238-bdea-3c9df0fe5411 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:00.215020 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b3009a09-7e9d-4238-bdea-3c9df0fe5411 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:00.215609 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b3009a09-7e9d-4238-bdea-3c9df0fe5411 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:00.216121 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b3009a09-7e9d-4238-bdea-3c9df0fe5411 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:00.216826 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b3009a09-7e9d-4238-bdea-3c9df0fe5411 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:00.217284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b3009a09-7e9d-4238-bdea-3c9df0fe5411 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:00.217711 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b3009a09-7e9d-4238-bdea-3c9df0fe5411 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:00.357695 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b3009a09-7e9d-4238-bdea-3c9df0fe5411 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:00.365904 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b3009a09-7e9d-4238-bdea-3c9df0fe5411 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1554 microversion: 2.1 time: 0.163270 Aug 17 07:28:00.366527 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 92/176] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:00 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:01.179922 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-4b0f757a-81d4-47c0-a889-9caf66f1804e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:01.180705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-4b0f757a-81d4-47c0-a889-9caf66f1804e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:01.188165 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4b0f757a-81d4-47c0-a889-9caf66f1804e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:01.188674 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4b0f757a-81d4-47c0-a889-9caf66f1804e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:01.189527 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4b0f757a-81d4-47c0-a889-9caf66f1804e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:01.190262 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4b0f757a-81d4-47c0-a889-9caf66f1804e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:01.190865 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4b0f757a-81d4-47c0-a889-9caf66f1804e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:01.191447 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4b0f757a-81d4-47c0-a889-9caf66f1804e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:01.374775 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-4b0f757a-81d4-47c0-a889-9caf66f1804e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:01.388226 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-8eca3600-e1d8-4b5f-a14d-51c9860f9e99 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:01.389236 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-8eca3600-e1d8-4b5f-a14d-51c9860f9e99 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:01.398659 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-4b0f757a-81d4-47c0-a889-9caf66f1804e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.222705 Aug 17 07:28:01.399481 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 85/177] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:01 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:01.400356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8eca3600-e1d8-4b5f-a14d-51c9860f9e99 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:01.401005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8eca3600-e1d8-4b5f-a14d-51c9860f9e99 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:01.401598 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8eca3600-e1d8-4b5f-a14d-51c9860f9e99 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:01.402630 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8eca3600-e1d8-4b5f-a14d-51c9860f9e99 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:01.403228 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8eca3600-e1d8-4b5f-a14d-51c9860f9e99 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:01.403831 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8eca3600-e1d8-4b5f-a14d-51c9860f9e99 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:01.555532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-8eca3600-e1d8-4b5f-a14d-51c9860f9e99 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:01.565136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-8eca3600-e1d8-4b5f-a14d-51c9860f9e99 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1554 microversion: 2.1 time: 0.181072 Aug 17 07:28:01.566054 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 93/178] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:01 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:02.412984 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-da0975cb-12e6-4dee-8548-b2bb219ebbec req-f126f190-c613-49e8-9798-cea9302de675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b55345ed-b67a-4e85-aa91-a1351ca5fdf1", "name": "network-vif-deleted", "tag": "1d23fdf6-efa9-43ab-a1df-ef927886dc2e"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:28:02.424028 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-8c57cc6c-df40-4abb-970f-8af0ee0ed00c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:02.424645 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-8c57cc6c-df40-4abb-970f-8af0ee0ed00c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:02.444236 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8c57cc6c-df40-4abb-970f-8af0ee0ed00c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:02.444794 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8c57cc6c-df40-4abb-970f-8af0ee0ed00c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:02.445224 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8c57cc6c-df40-4abb-970f-8af0ee0ed00c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:02.446046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8c57cc6c-df40-4abb-970f-8af0ee0ed00c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:02.446510 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8c57cc6c-df40-4abb-970f-8af0ee0ed00c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:02.446944 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8c57cc6c-df40-4abb-970f-8af0ee0ed00c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:02.458185 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-da0975cb-12e6-4dee-8548-b2bb219ebbec req-f126f190-c613-49e8-9798-cea9302de675 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:02.458652 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-da0975cb-12e6-4dee-8548-b2bb219ebbec req-f126f190-c613-49e8-9798-cea9302de675 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:02.460976 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-da0975cb-12e6-4dee-8548-b2bb219ebbec req-f126f190-c613-49e8-9798-cea9302de675 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:02.497235 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-da0975cb-12e6-4dee-8548-b2bb219ebbec req-f126f190-c613-49e8-9798-cea9302de675 service nova] Creating event network-vif-deleted:1d23fdf6-efa9-43ab-a1df-ef927886dc2e for instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 on hv-cinder-85312 Aug 17 07:28:02.536618 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-da0975cb-12e6-4dee-8548-b2bb219ebbec req-f126f190-c613-49e8-9798-cea9302de675 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127823 Aug 17 07:28:02.548467 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 86/179] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:28:02.588073 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0e4c6cec-b1da-4f99-b9a6-47d2d42a2958 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:02.589333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0e4c6cec-b1da-4f99-b9a6-47d2d42a2958 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:02.598121 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0e4c6cec-b1da-4f99-b9a6-47d2d42a2958 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:02.598121 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0e4c6cec-b1da-4f99-b9a6-47d2d42a2958 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:02.598536 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0e4c6cec-b1da-4f99-b9a6-47d2d42a2958 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:02.603427 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0e4c6cec-b1da-4f99-b9a6-47d2d42a2958 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:02.604097 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0e4c6cec-b1da-4f99-b9a6-47d2d42a2958 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:02.606418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0e4c6cec-b1da-4f99-b9a6-47d2d42a2958 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:03.005515 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0e4c6cec-b1da-4f99-b9a6-47d2d42a2958 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca68ccce2ae54eccbfb1afd171424746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3f36e86c51479c9bbe844a650ca355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:03.013594 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0e4c6cec-b1da-4f99-b9a6-47d2d42a2958 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 200 len: 1346 microversion: 2.1 time: 0.430181 Aug 17 07:28:03.016136 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 87/180] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:02 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 1346 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:28:03.138947 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-8c57cc6c-df40-4abb-970f-8af0ee0ed00c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:03.148216 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-8c57cc6c-df40-4abb-970f-8af0ee0ed00c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.729952 Aug 17 07:28:03.149256 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 94/181] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:02 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:28:04.039168 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-48eb3499-4fda-491f-8beb-b812e2b24a93 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:04.039778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-48eb3499-4fda-491f-8beb-b812e2b24a93 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:04.055019 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-48eb3499-4fda-491f-8beb-b812e2b24a93 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:04.055540 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-48eb3499-4fda-491f-8beb-b812e2b24a93 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:04.056063 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-48eb3499-4fda-491f-8beb-b812e2b24a93 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:04.057125 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-48eb3499-4fda-491f-8beb-b812e2b24a93 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:04.057985 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-48eb3499-4fda-491f-8beb-b812e2b24a93 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:04.058424 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-48eb3499-4fda-491f-8beb-b812e2b24a93 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:04.094077 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-48eb3499-4fda-491f-8beb-b812e2b24a93 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] HTTP exception thrown: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-48eb3499-4fda-491f-8beb-b812e2b24a93 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Request method failure captured: Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 HTTP/1.1 Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JhHPVR-v_jFG7K3LSVzp7omVVWG6p4RPC53ydmprmjZTvgxYEc4gMmOoedVZR8ReqeuqJv2bekKuIqu5ZqqArXrGvnpZ7miR7VgIxrlk3aAD9ctqXslR96yaGhpTu3jEGNcfSNzOiJbTwK8nBG-plGNRCfeB0oo1VcXvD8KBTnnCEQ Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 2c3f36e86c51479c9bbe844a650ca355 Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-DeleteServersTestJSON-545897290 Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:28:04.100992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:28:04.102436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2c3f36e86c51479c9bbe844a650ca355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2c3f36e86c51479c9bbe844a650ca355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2c3f36e86c51479c9bbe844a650ca355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2c3f36e86c51479c9bbe844a650ca355"}]}] Aug 17 07:28:04.102436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-DeleteServersTestJSON-545897290 Aug 17 07:28:04.102436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 2c3f36e86c51479c9bbe844a650ca355 Aug 17 07:28:04.102436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-DeleteServersTestJSON-545897290 Aug 17 07:28:04.102436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-DeleteServersTestJSON-545897290-project Aug 17 07:28:04.102436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:28:04.102436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:28:04.102436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: ca68ccce2ae54eccbfb1afd171424746 Aug 17 07:28:04.102436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-DeleteServersTestJSON-545897290-project Aug 17 07:28:04.102436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:28:04.102436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:04.102436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': 'b55345ed-b67a-4e85-aa91-a1351ca5fdf1'} Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:28:04.106496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:28:04.107740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:28:04.107740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:28:04.107740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:28:04.107740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:28:04.107740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:28:04.107740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:28:04.107740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:28:04.107740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:04.107740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:04.107740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:28:04.107740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:04.107740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:28:04.107740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:28:04.107740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:28:04.107740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:28:04.107740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:28:04.107740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:04.107740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:04.108849 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-48eb3499-4fda-491f-8beb-b812e2b24a93 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Returning 404 to user: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:28:04.108849 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-48eb3499-4fda-491f-8beb-b812e2b24a93 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 404 len: 111 microversion: 2.1 time: 0.070044 Aug 17 07:28:04.108849 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 88/182] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:04 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:28:04.169846 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-6b7ed256-14eb-431f-82a5-56d168b86d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:04.171022 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-6b7ed256-14eb-431f-82a5-56d168b86d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:04.180760 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6b7ed256-14eb-431f-82a5-56d168b86d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:04.182502 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6b7ed256-14eb-431f-82a5-56d168b86d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:04.183257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6b7ed256-14eb-431f-82a5-56d168b86d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:04.184188 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6b7ed256-14eb-431f-82a5-56d168b86d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:04.184791 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6b7ed256-14eb-431f-82a5-56d168b86d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:04.185227 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6b7ed256-14eb-431f-82a5-56d168b86d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:04.301254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9ef2b962-ce82-473b-b6f1-460434784db9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:04.303933 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9ef2b962-ce82-473b-b6f1-460434784db9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:04.310370 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ef2b962-ce82-473b-b6f1-460434784db9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:04.311146 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ef2b962-ce82-473b-b6f1-460434784db9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:04.311463 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ef2b962-ce82-473b-b6f1-460434784db9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:04.315385 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ef2b962-ce82-473b-b6f1-460434784db9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:04.316081 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ef2b962-ce82-473b-b6f1-460434784db9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:04.316884 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ef2b962-ce82-473b-b6f1-460434784db9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:04.336044 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-9ef2b962-ce82-473b-b6f1-460434784db9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] HTTP exception thrown: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9ef2b962-ce82-473b-b6f1-460434784db9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Request method failure captured: Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1/os-volume_attachments HTTP/1.1 Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JhHPVR-v_jFG7K3LSVzp7omVVWG6p4RPC53ydmprmjZTvgxYEc4gMmOoedVZR8ReqeuqJv2bekKuIqu5ZqqArXrGvnpZ7miR7VgIxrlk3aAD9ctqXslR96yaGhpTu3jEGNcfSNzOiJbTwK8nBG-plGNRCfeB0oo1VcXvD8KBTnnCEQ Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 2c3f36e86c51479c9bbe844a650ca355 Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-DeleteServersTestJSON-545897290 Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:28:04.351658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:28:04.352939 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2c3f36e86c51479c9bbe844a650ca355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2c3f36e86c51479c9bbe844a650ca355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2c3f36e86c51479c9bbe844a650ca355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2c3f36e86c51479c9bbe844a650ca355"}]}] Aug 17 07:28:04.352939 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-DeleteServersTestJSON-545897290 Aug 17 07:28:04.352939 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 2c3f36e86c51479c9bbe844a650ca355 Aug 17 07:28:04.352939 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-DeleteServersTestJSON-545897290 Aug 17 07:28:04.352939 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-DeleteServersTestJSON-545897290-project Aug 17 07:28:04.352939 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:28:04.352939 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:28:04.352939 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: ca68ccce2ae54eccbfb1afd171424746 Aug 17 07:28:04.352939 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-DeleteServersTestJSON-545897290-project Aug 17 07:28:04.352939 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:28:04.352939 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:04.352939 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'server_id': 'b55345ed-b67a-4e85-aa91-a1351ca5fdf1'} Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:28:04.353612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:04.355331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:04.356424 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9ef2b962-ce82-473b-b6f1-460434784db9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Returning 404 to user: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:28:04.356424 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9ef2b962-ce82-473b-b6f1-460434784db9 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.058133 Aug 17 07:28:04.359854 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 89/183] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:28:04 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1/os-volume_attachments => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:28:04.474678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-6b7ed256-14eb-431f-82a5-56d168b86d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:04.483988 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-6b7ed256-14eb-431f-82a5-56d168b86d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.318419 Aug 17 07:28:04.484949 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 95/184] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:04 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:05.508965 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-24e5107b-711f-4b16-9647-741f7e903c77 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:05.509658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-24e5107b-711f-4b16-9647-741f7e903c77 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:05.518114 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-24e5107b-711f-4b16-9647-741f7e903c77 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:05.518844 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-24e5107b-711f-4b16-9647-741f7e903c77 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:05.519484 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-24e5107b-711f-4b16-9647-741f7e903c77 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:05.520437 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-24e5107b-711f-4b16-9647-741f7e903c77 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:05.521072 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-24e5107b-711f-4b16-9647-741f7e903c77 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:05.521677 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-24e5107b-711f-4b16-9647-741f7e903c77 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:05.752348 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-24e5107b-711f-4b16-9647-741f7e903c77 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:05.762600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-24e5107b-711f-4b16-9647-741f7e903c77 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.258541 Aug 17 07:28:05.774362 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 90/185] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:05 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:06.783587 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-f8a82063-aefb-49b6-a32e-995ebf38f832 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:06.784777 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-f8a82063-aefb-49b6-a32e-995ebf38f832 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:06.790854 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f8a82063-aefb-49b6-a32e-995ebf38f832 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:06.791332 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f8a82063-aefb-49b6-a32e-995ebf38f832 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:06.791768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f8a82063-aefb-49b6-a32e-995ebf38f832 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:06.792491 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f8a82063-aefb-49b6-a32e-995ebf38f832 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:06.793042 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f8a82063-aefb-49b6-a32e-995ebf38f832 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:06.793541 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f8a82063-aefb-49b6-a32e-995ebf38f832 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:06.815303 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:07.151411 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-f8a82063-aefb-49b6-a32e-995ebf38f832 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:07.159484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-f8a82063-aefb-49b6-a32e-995ebf38f832 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.379833 Aug 17 07:28:07.160047 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 96/186] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:06 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:08.183252 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a41c7fd2-8bda-4043-824e-0bc4e92d219a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:08.183806 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-a41c7fd2-8bda-4043-824e-0bc4e92d219a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:08.196607 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a41c7fd2-8bda-4043-824e-0bc4e92d219a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:08.197315 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a41c7fd2-8bda-4043-824e-0bc4e92d219a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:08.197747 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a41c7fd2-8bda-4043-824e-0bc4e92d219a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:08.201849 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a41c7fd2-8bda-4043-824e-0bc4e92d219a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:08.202573 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a41c7fd2-8bda-4043-824e-0bc4e92d219a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:08.203008 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a41c7fd2-8bda-4043-824e-0bc4e92d219a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:08.442135 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a41c7fd2-8bda-4043-824e-0bc4e92d219a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:08.460596 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a41c7fd2-8bda-4043-824e-0bc4e92d219a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.280166 Aug 17 07:28:08.462428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 91/187] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:08 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:08.807751 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b66bf06b-03e2-4006-93b4-ed31d2faf1a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:08.808364 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-b66bf06b-03e2-4006-93b4-ed31d2faf1a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:08.814757 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b66bf06b-03e2-4006-93b4-ed31d2faf1a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:08.815336 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b66bf06b-03e2-4006-93b4-ed31d2faf1a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:08.815958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b66bf06b-03e2-4006-93b4-ed31d2faf1a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:08.816739 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b66bf06b-03e2-4006-93b4-ed31d2faf1a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:08.817513 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b66bf06b-03e2-4006-93b4-ed31d2faf1a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:08.817811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b66bf06b-03e2-4006-93b4-ed31d2faf1a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:08.831931 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-b66bf06b-03e2-4006-93b4-ed31d2faf1a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] HTTP exception thrown: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b66bf06b-03e2-4006-93b4-ed31d2faf1a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Request method failure captured: Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: DELETE /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 HTTP/1.1 Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JhHPVR-v_jFG7K3LSVzp7omVVWG6p4RPC53ydmprmjZTvgxYEc4gMmOoedVZR8ReqeuqJv2bekKuIqu5ZqqArXrGvnpZ7miR7VgIxrlk3aAD9ctqXslR96yaGhpTu3jEGNcfSNzOiJbTwK8nBG-plGNRCfeB0oo1VcXvD8KBTnnCEQ Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 2c3f36e86c51479c9bbe844a650ca355 Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-DeleteServersTestJSON-545897290 Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:28:08.837531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:28:08.839086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2c3f36e86c51479c9bbe844a650ca355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2c3f36e86c51479c9bbe844a650ca355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2c3f36e86c51479c9bbe844a650ca355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2c3f36e86c51479c9bbe844a650ca355"}]}] Aug 17 07:28:08.839086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-DeleteServersTestJSON-545897290 Aug 17 07:28:08.839086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 2c3f36e86c51479c9bbe844a650ca355 Aug 17 07:28:08.839086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-DeleteServersTestJSON-545897290 Aug 17 07:28:08.839086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-DeleteServersTestJSON-545897290-project Aug 17 07:28:08.839086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:28:08.839086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:28:08.839086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: ca68ccce2ae54eccbfb1afd171424746 Aug 17 07:28:08.839086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-DeleteServersTestJSON-545897290-project Aug 17 07:28:08.839086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:28:08.839086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:08.839086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': 'b55345ed-b67a-4e85-aa91-a1351ca5fdf1'} Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:28:08.840064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:08.841733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:28:08.844741 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b66bf06b-03e2-4006-93b4-ed31d2faf1a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Returning 404 to user: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:28:08.845606 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b66bf06b-03e2-4006-93b4-ed31d2faf1a1 tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 404 len: 111 microversion: 2.1 time: 0.042175 Aug 17 07:28:08.846502 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 97/188] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:28:08 2022] DELETE /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:28:08.856656 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1d501a6e-1a9e-4f53-8a0e-94e79b318eef tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:08.857620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-1d501a6e-1a9e-4f53-8a0e-94e79b318eef tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] [instance: b55345ed-b67a-4e85-aa91-a1351ca5fdf1] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:08.865100 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1d501a6e-1a9e-4f53-8a0e-94e79b318eef tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:08.865632 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1d501a6e-1a9e-4f53-8a0e-94e79b318eef tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:08.866353 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1d501a6e-1a9e-4f53-8a0e-94e79b318eef tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:08.867434 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1d501a6e-1a9e-4f53-8a0e-94e79b318eef tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:08.868097 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1d501a6e-1a9e-4f53-8a0e-94e79b318eef tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:08.868713 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1d501a6e-1a9e-4f53-8a0e-94e79b318eef tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:08.883398 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-1d501a6e-1a9e-4f53-8a0e-94e79b318eef tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] HTTP exception thrown: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1d501a6e-1a9e-4f53-8a0e-94e79b318eef tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Request method failure captured: Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 HTTP/1.1 Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JhHPVR-v_jFG7K3LSVzp7omVVWG6p4RPC53ydmprmjZTvgxYEc4gMmOoedVZR8ReqeuqJv2bekKuIqu5ZqqArXrGvnpZ7miR7VgIxrlk3aAD9ctqXslR96yaGhpTu3jEGNcfSNzOiJbTwK8nBG-plGNRCfeB0oo1VcXvD8KBTnnCEQ Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 2c3f36e86c51479c9bbe844a650ca355 Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-DeleteServersTestJSON-545897290 Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:28:08.885493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:28:08.887014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2c3f36e86c51479c9bbe844a650ca355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2c3f36e86c51479c9bbe844a650ca355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2c3f36e86c51479c9bbe844a650ca355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2c3f36e86c51479c9bbe844a650ca355"}]}] Aug 17 07:28:08.887014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-DeleteServersTestJSON-545897290 Aug 17 07:28:08.887014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 2c3f36e86c51479c9bbe844a650ca355 Aug 17 07:28:08.887014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-DeleteServersTestJSON-545897290 Aug 17 07:28:08.887014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-DeleteServersTestJSON-545897290-project Aug 17 07:28:08.887014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:28:08.887014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:28:08.887014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: ca68ccce2ae54eccbfb1afd171424746 Aug 17 07:28:08.887014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-DeleteServersTestJSON-545897290-project Aug 17 07:28:08.887014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:28:08.887014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:08.887014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': 'b55345ed-b67a-4e85-aa91-a1351ca5fdf1'} Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:28:08.887777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:28:08.888898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:28:08.888898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:28:08.888898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:28:08.888898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:28:08.888898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:28:08.888898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:28:08.888898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:28:08.888898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:08.888898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:08.888898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:28:08.888898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:08.888898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:28:08.888898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:28:08.888898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:28:08.888898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:28:08.888898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:28:08.888898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. Aug 17 07:28:08.888898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:08.890543 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1d501a6e-1a9e-4f53-8a0e-94e79b318eef tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] Returning 404 to user: Instance b55345ed-b67a-4e85-aa91-a1351ca5fdf1 could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:28:08.890543 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-1d501a6e-1a9e-4f53-8a0e-94e79b318eef tempest-DeleteServersTestJSON-545897290 tempest-DeleteServersTestJSON-545897290-project] 10.222.0.45 "GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1" status: 404 len: 111 microversion: 2.1 time: 0.035378 Aug 17 07:28:08.893044 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 92/189] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:08 2022] GET /compute/v2.1/servers/b55345ed-b67a-4e85-aa91-a1351ca5fdf1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:28:09.490268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d674f944-03f2-444d-a179-1ba9984cb461 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:09.491102 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d674f944-03f2-444d-a179-1ba9984cb461 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:09.500274 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d674f944-03f2-444d-a179-1ba9984cb461 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:09.504905 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d674f944-03f2-444d-a179-1ba9984cb461 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:09.505615 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d674f944-03f2-444d-a179-1ba9984cb461 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:09.506534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d674f944-03f2-444d-a179-1ba9984cb461 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:09.507134 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d674f944-03f2-444d-a179-1ba9984cb461 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:09.507704 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d674f944-03f2-444d-a179-1ba9984cb461 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:09.904219 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d674f944-03f2-444d-a179-1ba9984cb461 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:09.916829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d674f944-03f2-444d-a179-1ba9984cb461 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.428117 Aug 17 07:28:09.916829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 98/190] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:09 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:10.942848 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0549f0e8-e08e-4ce6-a9e5-35d1a2c559e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:10.944270 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0549f0e8-e08e-4ce6-a9e5-35d1a2c559e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:10.960458 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0549f0e8-e08e-4ce6-a9e5-35d1a2c559e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:10.961318 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0549f0e8-e08e-4ce6-a9e5-35d1a2c559e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:10.961996 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0549f0e8-e08e-4ce6-a9e5-35d1a2c559e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:10.963318 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0549f0e8-e08e-4ce6-a9e5-35d1a2c559e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:10.964003 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0549f0e8-e08e-4ce6-a9e5-35d1a2c559e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:10.965508 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0549f0e8-e08e-4ce6-a9e5-35d1a2c559e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:10.986343 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:11.364718 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0549f0e8-e08e-4ce6-a9e5-35d1a2c559e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:11.374188 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0549f0e8-e08e-4ce6-a9e5-35d1a2c559e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.435673 Aug 17 07:28:11.383113 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 93/191] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:10 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:12.406569 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-5977fd36-9949-4ac9-bfab-b6e16634211b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:12.407807 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-5977fd36-9949-4ac9-bfab-b6e16634211b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:12.415389 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5977fd36-9949-4ac9-bfab-b6e16634211b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:12.416032 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5977fd36-9949-4ac9-bfab-b6e16634211b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:12.416618 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5977fd36-9949-4ac9-bfab-b6e16634211b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:12.417488 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5977fd36-9949-4ac9-bfab-b6e16634211b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:12.418106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5977fd36-9949-4ac9-bfab-b6e16634211b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:12.418535 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5977fd36-9949-4ac9-bfab-b6e16634211b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:12.814136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-5977fd36-9949-4ac9-bfab-b6e16634211b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:12.821879 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-5977fd36-9949-4ac9-bfab-b6e16634211b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.421046 Aug 17 07:28:12.825433 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 99/192] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:12 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:13.851782 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f2af8cde-c43e-4ad0-9765-9ecd4ba7971e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:13.853642 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f2af8cde-c43e-4ad0-9765-9ecd4ba7971e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:13.867794 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f2af8cde-c43e-4ad0-9765-9ecd4ba7971e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:13.868937 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f2af8cde-c43e-4ad0-9765-9ecd4ba7971e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:13.869481 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f2af8cde-c43e-4ad0-9765-9ecd4ba7971e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:13.870719 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f2af8cde-c43e-4ad0-9765-9ecd4ba7971e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:13.871392 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f2af8cde-c43e-4ad0-9765-9ecd4ba7971e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:13.877521 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f2af8cde-c43e-4ad0-9765-9ecd4ba7971e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:14.232700 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f2af8cde-c43e-4ad0-9765-9ecd4ba7971e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:14.245440 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f2af8cde-c43e-4ad0-9765-9ecd4ba7971e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.399402 Aug 17 07:28:14.247912 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 94/193] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:13 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:14.474168 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-8023a8d3-4ae9-4181-960a-a314d6727046 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Action: 'create', calling method: .version_select at 0x7f30acd04940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-800034190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHc/K9JPdq3LicYR8+KEXUZpzf/RMbdbe2X9QfDVnVB2cu65zeSlDGhlpoxK0q4Wu8OoTrsXDFPx1azON9kkO+cnMT/E+LtdMSc/TAXkb0hNDFnWDBrN9Gs1qjnuYAzJw=="}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:28:14.505921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-8023a8d3-4ae9-4181-960a-a314d6727046 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Getting quotas for project afb93daca17c466da3a698536c6b323f. Resources: {'key_pairs'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:28:14.511714 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-8023a8d3-4ae9-4181-960a-a314d6727046 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Getting quotas for user b2e79830079c4aa9b95c4622bac45c74 and project afb93daca17c466da3a698536c6b323f. Resources: {'key_pairs'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:28:14.578128 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-8023a8d3-4ae9-4181-960a-a314d6727046 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.429242 Aug 17 07:28:14.579278 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 100/194] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 17 07:28:14 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:28:15.267459 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-35a260df-2b7e-48c8-bfb8-423e73227d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:15.268825 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-35a260df-2b7e-48c8-bfb8-423e73227d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:15.284059 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-35a260df-2b7e-48c8-bfb8-423e73227d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:15.285820 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-35a260df-2b7e-48c8-bfb8-423e73227d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:15.288651 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-35a260df-2b7e-48c8-bfb8-423e73227d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:15.290017 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-35a260df-2b7e-48c8-bfb8-423e73227d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:15.291698 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-35a260df-2b7e-48c8-bfb8-423e73227d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:15.292393 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-35a260df-2b7e-48c8-bfb8-423e73227d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:15.579816 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-35a260df-2b7e-48c8-bfb8-423e73227d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:15.588516 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-35a260df-2b7e-48c8-bfb8-423e73227d08 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1523 microversion: 2.1 time: 0.325737 Aug 17 07:28:15.593291 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 95/195] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:15 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1523 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:16.614445 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a2ff2675-53a0-46af-8f75-13c334287896 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:16.615865 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a2ff2675-53a0-46af-8f75-13c334287896 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:16.624841 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a2ff2675-53a0-46af-8f75-13c334287896 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:16.626017 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a2ff2675-53a0-46af-8f75-13c334287896 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:16.626819 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a2ff2675-53a0-46af-8f75-13c334287896 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:16.628393 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a2ff2675-53a0-46af-8f75-13c334287896 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:16.629162 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a2ff2675-53a0-46af-8f75-13c334287896 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:16.629797 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a2ff2675-53a0-46af-8f75-13c334287896 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:16.816039 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a2ff2675-53a0-46af-8f75-13c334287896 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:16.824256 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a2ff2675-53a0-46af-8f75-13c334287896 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1503 microversion: 2.1 time: 0.214895 Aug 17 07:28:16.824845 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 101/196] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:16 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1503 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:16.847721 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b81aca57-87eb-4fc5-a4c6-217c7ee797fc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:16.848335 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-b81aca57-87eb-4fc5-a4c6-217c7ee797fc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:16.864195 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b81aca57-87eb-4fc5-a4c6-217c7ee797fc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:16.864698 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b81aca57-87eb-4fc5-a4c6-217c7ee797fc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:16.865159 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b81aca57-87eb-4fc5-a4c6-217c7ee797fc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:16.865833 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b81aca57-87eb-4fc5-a4c6-217c7ee797fc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:16.866309 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b81aca57-87eb-4fc5-a4c6-217c7ee797fc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:16.866996 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b81aca57-87eb-4fc5-a4c6-217c7ee797fc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:17.153672 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-b81aca57-87eb-4fc5-a4c6-217c7ee797fc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:17.165409 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b81aca57-87eb-4fc5-a4c6-217c7ee797fc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1515 microversion: 2.1 time: 0.321445 Aug 17 07:28:17.167635 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 96/197] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:16 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1515 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:18.868133 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-6863be8e-f5cf-4401-b8de-7fc640075d85 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:28:18.873365 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-6863be8e-f5cf-4401-b8de-7fc640075d85 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:18.882844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6863be8e-f5cf-4401-b8de-7fc640075d85 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:18.883323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6863be8e-f5cf-4401-b8de-7fc640075d85 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:18.883755 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6863be8e-f5cf-4401-b8de-7fc640075d85 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:18.884667 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6863be8e-f5cf-4401-b8de-7fc640075d85 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:18.885117 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6863be8e-f5cf-4401-b8de-7fc640075d85 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:18.885545 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6863be8e-f5cf-4401-b8de-7fc640075d85 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:18.929256 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.objects.instance [None req-6863be8e-f5cf-4401-b8de-7fc640075d85 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lazy-loading 'flavor' on Instance uuid 479d4f33-9d2a-4cec-84c9-18c739e2374f {{(pid=120835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:28:19.046326 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-6863be8e-f5cf-4401-b8de-7fc640075d85 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "POST /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f/action" status: 200 len: 32 microversion: 2.1 time: 0.184767 Aug 17 07:28:19.046940 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 102/198] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 17 07:28:18 2022] POST /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f/action => generated 32 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 07:28:19.056581 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-79a52a61-5636-4cfc-8f6b-5b689696b4af tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:19.057223 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-79a52a61-5636-4cfc-8f6b-5b689696b4af tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:19.065607 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-79a52a61-5636-4cfc-8f6b-5b689696b4af tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:19.066118 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-79a52a61-5636-4cfc-8f6b-5b689696b4af tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:19.066581 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-79a52a61-5636-4cfc-8f6b-5b689696b4af tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:19.067526 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-79a52a61-5636-4cfc-8f6b-5b689696b4af tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:19.068176 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-79a52a61-5636-4cfc-8f6b-5b689696b4af tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:19.068601 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-79a52a61-5636-4cfc-8f6b-5b689696b4af tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:19.240326 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-79a52a61-5636-4cfc-8f6b-5b689696b4af tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:19.249379 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-79a52a61-5636-4cfc-8f6b-5b689696b4af tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.196275 Aug 17 07:28:19.250226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 97/199] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:19 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:28:20.271631 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c01adaa9-49e9-4b69-bf02-4ab10db5844d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:20.272915 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-c01adaa9-49e9-4b69-bf02-4ab10db5844d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:20.279635 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c01adaa9-49e9-4b69-bf02-4ab10db5844d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:20.280798 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c01adaa9-49e9-4b69-bf02-4ab10db5844d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:20.281419 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c01adaa9-49e9-4b69-bf02-4ab10db5844d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:20.282157 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c01adaa9-49e9-4b69-bf02-4ab10db5844d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:20.282613 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c01adaa9-49e9-4b69-bf02-4ab10db5844d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:20.283047 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c01adaa9-49e9-4b69-bf02-4ab10db5844d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:20.447095 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c01adaa9-49e9-4b69-bf02-4ab10db5844d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:20.455277 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-c01adaa9-49e9-4b69-bf02-4ab10db5844d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.187966 Aug 17 07:28:20.456018 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 103/200] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:20 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:21.476386 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1620c17d-1392-46c0-b3ae-defd20a250c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:21.477808 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-1620c17d-1392-46c0-b3ae-defd20a250c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:21.486059 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1620c17d-1392-46c0-b3ae-defd20a250c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:21.486726 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1620c17d-1392-46c0-b3ae-defd20a250c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:21.487745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1620c17d-1392-46c0-b3ae-defd20a250c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:21.488468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1620c17d-1392-46c0-b3ae-defd20a250c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:21.489018 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1620c17d-1392-46c0-b3ae-defd20a250c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:21.489639 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1620c17d-1392-46c0-b3ae-defd20a250c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:21.670580 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-1620c17d-1392-46c0-b3ae-defd20a250c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:21.688619 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-1620c17d-1392-46c0-b3ae-defd20a250c9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.215821 Aug 17 07:28:21.689516 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 98/201] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:21 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:22.710964 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-71a03c43-25f6-4c6b-ac7a-b96257a7ecb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:22.711572 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-71a03c43-25f6-4c6b-ac7a-b96257a7ecb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:22.718749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-71a03c43-25f6-4c6b-ac7a-b96257a7ecb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:22.720537 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-71a03c43-25f6-4c6b-ac7a-b96257a7ecb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:22.721895 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-71a03c43-25f6-4c6b-ac7a-b96257a7ecb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:22.723151 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-71a03c43-25f6-4c6b-ac7a-b96257a7ecb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:22.723802 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-71a03c43-25f6-4c6b-ac7a-b96257a7ecb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:22.724306 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-71a03c43-25f6-4c6b-ac7a-b96257a7ecb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:22.881429 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-71a03c43-25f6-4c6b-ac7a-b96257a7ecb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:22.889280 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-71a03c43-25f6-4c6b-ac7a-b96257a7ecb6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.182003 Aug 17 07:28:22.890484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 104/202] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:22 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:23.912015 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-5a5990a9-500f-41ce-b1e0-7cfeec80af07 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:23.912678 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-5a5990a9-500f-41ce-b1e0-7cfeec80af07 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:23.915261 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:23.921463 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5a5990a9-500f-41ce-b1e0-7cfeec80af07 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:23.922507 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5a5990a9-500f-41ce-b1e0-7cfeec80af07 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:23.923109 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5a5990a9-500f-41ce-b1e0-7cfeec80af07 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:23.924357 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5a5990a9-500f-41ce-b1e0-7cfeec80af07 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:23.925303 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5a5990a9-500f-41ce-b1e0-7cfeec80af07 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:23.926255 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5a5990a9-500f-41ce-b1e0-7cfeec80af07 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:24.137214 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-5a5990a9-500f-41ce-b1e0-7cfeec80af07 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:24.146441 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-5a5990a9-500f-41ce-b1e0-7cfeec80af07 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.239022 Aug 17 07:28:24.147012 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 99/203] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:23 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:25.168890 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ef35a034-057f-4801-9eb2-662fbc41d074 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:25.169504 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-ef35a034-057f-4801-9eb2-662fbc41d074 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:25.171524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=4 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:25.172768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:25.179206 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef35a034-057f-4801-9eb2-662fbc41d074 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:25.179677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef35a034-057f-4801-9eb2-662fbc41d074 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:25.180210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef35a034-057f-4801-9eb2-662fbc41d074 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:25.180811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef35a034-057f-4801-9eb2-662fbc41d074 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:25.181261 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef35a034-057f-4801-9eb2-662fbc41d074 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:25.181685 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef35a034-057f-4801-9eb2-662fbc41d074 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:25.355195 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ef35a034-057f-4801-9eb2-662fbc41d074 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:25.364699 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-ef35a034-057f-4801-9eb2-662fbc41d074 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.199846 Aug 17 07:28:25.366356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 105/204] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:25 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:26.393109 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-94370126-eb62-4cde-bcfd-7084e1bfdd0c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:26.393712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-94370126-eb62-4cde-bcfd-7084e1bfdd0c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:26.400248 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94370126-eb62-4cde-bcfd-7084e1bfdd0c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:26.400712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94370126-eb62-4cde-bcfd-7084e1bfdd0c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:26.401157 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94370126-eb62-4cde-bcfd-7084e1bfdd0c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:26.402052 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94370126-eb62-4cde-bcfd-7084e1bfdd0c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:26.402507 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94370126-eb62-4cde-bcfd-7084e1bfdd0c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:26.402930 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94370126-eb62-4cde-bcfd-7084e1bfdd0c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:26.534915 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-94370126-eb62-4cde-bcfd-7084e1bfdd0c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:26.542234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-94370126-eb62-4cde-bcfd-7084e1bfdd0c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.153464 Aug 17 07:28:26.542791 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 100/205] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:26 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:27.562987 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b5899747-525a-415a-ab16-f32ee1a7ca39 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:27.563577 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-b5899747-525a-415a-ab16-f32ee1a7ca39 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:27.569675 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b5899747-525a-415a-ab16-f32ee1a7ca39 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:27.570189 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b5899747-525a-415a-ab16-f32ee1a7ca39 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:27.570625 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b5899747-525a-415a-ab16-f32ee1a7ca39 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:27.571316 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b5899747-525a-415a-ab16-f32ee1a7ca39 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:27.571802 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b5899747-525a-415a-ab16-f32ee1a7ca39 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:27.572227 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b5899747-525a-415a-ab16-f32ee1a7ca39 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:27.704498 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b5899747-525a-415a-ab16-f32ee1a7ca39 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:27.711844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b5899747-525a-415a-ab16-f32ee1a7ca39 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.152683 Aug 17 07:28:27.712410 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 106/206] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:27 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:28.733658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-8b139282-8728-4f66-a667-2701af8b6532 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:28.734326 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-8b139282-8728-4f66-a667-2701af8b6532 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:28.741173 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8b139282-8728-4f66-a667-2701af8b6532 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:28.741651 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8b139282-8728-4f66-a667-2701af8b6532 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:28.742398 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8b139282-8728-4f66-a667-2701af8b6532 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:28.743083 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8b139282-8728-4f66-a667-2701af8b6532 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:28.743547 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8b139282-8728-4f66-a667-2701af8b6532 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:28.744158 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8b139282-8728-4f66-a667-2701af8b6532 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:28.875023 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-8b139282-8728-4f66-a667-2701af8b6532 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:28.882830 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-8b139282-8728-4f66-a667-2701af8b6532 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.153880 Aug 17 07:28:28.883404 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 101/207] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:28 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:29.903767 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-5b2758ee-1d63-4aa9-893c-714842b65a01 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:29.904375 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-5b2758ee-1d63-4aa9-893c-714842b65a01 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:29.910354 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5b2758ee-1d63-4aa9-893c-714842b65a01 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:29.910830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5b2758ee-1d63-4aa9-893c-714842b65a01 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:29.911260 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5b2758ee-1d63-4aa9-893c-714842b65a01 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:29.911937 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5b2758ee-1d63-4aa9-893c-714842b65a01 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:29.912382 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5b2758ee-1d63-4aa9-893c-714842b65a01 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:29.912800 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5b2758ee-1d63-4aa9-893c-714842b65a01 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:30.044524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-5b2758ee-1d63-4aa9-893c-714842b65a01 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:30.052396 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-5b2758ee-1d63-4aa9-893c-714842b65a01 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.152462 Aug 17 07:28:30.052955 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 107/208] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:29 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:31.075157 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-89cc53d2-8a10-4240-994b-368408ac514c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:31.075763 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-89cc53d2-8a10-4240-994b-368408ac514c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:31.082926 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-89cc53d2-8a10-4240-994b-368408ac514c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:31.083403 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-89cc53d2-8a10-4240-994b-368408ac514c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:31.083838 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-89cc53d2-8a10-4240-994b-368408ac514c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:31.084522 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-89cc53d2-8a10-4240-994b-368408ac514c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:31.084979 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-89cc53d2-8a10-4240-994b-368408ac514c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:31.085401 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-89cc53d2-8a10-4240-994b-368408ac514c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:31.218171 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-89cc53d2-8a10-4240-994b-368408ac514c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:31.225606 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-89cc53d2-8a10-4240-994b-368408ac514c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.154420 Aug 17 07:28:31.226196 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 102/209] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:31 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:32.248260 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-7168dab8-4447-43a5-a86d-a7675618311b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:32.248986 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-7168dab8-4447-43a5-a86d-a7675618311b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:32.259400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7168dab8-4447-43a5-a86d-a7675618311b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:32.260177 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7168dab8-4447-43a5-a86d-a7675618311b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:32.260619 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7168dab8-4447-43a5-a86d-a7675618311b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:32.261330 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7168dab8-4447-43a5-a86d-a7675618311b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:32.261779 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7168dab8-4447-43a5-a86d-a7675618311b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:32.262232 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7168dab8-4447-43a5-a86d-a7675618311b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:32.436632 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-7168dab8-4447-43a5-a86d-a7675618311b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:32.447973 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-7168dab8-4447-43a5-a86d-a7675618311b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.204875 Aug 17 07:28:32.448720 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 108/210] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:32 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:33.472426 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-4cd4c2f8-200a-4281-b824-c667ccc01c04 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:33.473430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-4cd4c2f8-200a-4281-b824-c667ccc01c04 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:33.480718 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4cd4c2f8-200a-4281-b824-c667ccc01c04 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:33.481271 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4cd4c2f8-200a-4281-b824-c667ccc01c04 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:33.481915 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4cd4c2f8-200a-4281-b824-c667ccc01c04 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:33.482637 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4cd4c2f8-200a-4281-b824-c667ccc01c04 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:33.483261 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4cd4c2f8-200a-4281-b824-c667ccc01c04 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:33.483804 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4cd4c2f8-200a-4281-b824-c667ccc01c04 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:33.633101 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-4cd4c2f8-200a-4281-b824-c667ccc01c04 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:33.640960 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-4cd4c2f8-200a-4281-b824-c667ccc01c04 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.172257 Aug 17 07:28:33.641617 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 103/211] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:33 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:34.666991 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-eb5849bc-2ac2-40ab-b2ec-3ebc9de8f57f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:34.667734 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-eb5849bc-2ac2-40ab-b2ec-3ebc9de8f57f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:34.674317 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eb5849bc-2ac2-40ab-b2ec-3ebc9de8f57f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:34.674863 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eb5849bc-2ac2-40ab-b2ec-3ebc9de8f57f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:34.675399 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eb5849bc-2ac2-40ab-b2ec-3ebc9de8f57f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:34.676136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eb5849bc-2ac2-40ab-b2ec-3ebc9de8f57f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:34.676634 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eb5849bc-2ac2-40ab-b2ec-3ebc9de8f57f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:34.677263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eb5849bc-2ac2-40ab-b2ec-3ebc9de8f57f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:34.832104 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-eb5849bc-2ac2-40ab-b2ec-3ebc9de8f57f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:34.840051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-eb5849bc-2ac2-40ab-b2ec-3ebc9de8f57f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.177862 Aug 17 07:28:34.840616 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 109/212] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:34 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:35.861483 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-db4faba9-9ba5-437b-a07e-42608a493c56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:35.862541 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-db4faba9-9ba5-437b-a07e-42608a493c56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:35.868867 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-db4faba9-9ba5-437b-a07e-42608a493c56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:35.869342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-db4faba9-9ba5-437b-a07e-42608a493c56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:35.869772 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-db4faba9-9ba5-437b-a07e-42608a493c56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:35.870486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-db4faba9-9ba5-437b-a07e-42608a493c56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:35.870933 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-db4faba9-9ba5-437b-a07e-42608a493c56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:35.871349 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-db4faba9-9ba5-437b-a07e-42608a493c56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:36.000895 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-db4faba9-9ba5-437b-a07e-42608a493c56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:36.008299 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-db4faba9-9ba5-437b-a07e-42608a493c56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.151446 Aug 17 07:28:36.008845 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 104/213] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:35 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:37.032344 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-78fd809e-087b-455a-828c-859fa7d0976e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:37.032913 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-78fd809e-087b-455a-828c-859fa7d0976e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:37.039166 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-78fd809e-087b-455a-828c-859fa7d0976e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:37.039843 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-78fd809e-087b-455a-828c-859fa7d0976e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:37.040273 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-78fd809e-087b-455a-828c-859fa7d0976e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:37.040964 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-78fd809e-087b-455a-828c-859fa7d0976e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:37.041418 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-78fd809e-087b-455a-828c-859fa7d0976e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:37.041842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-78fd809e-087b-455a-828c-859fa7d0976e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:37.044505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:37.182681 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-78fd809e-087b-455a-828c-859fa7d0976e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:37.190110 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-78fd809e-087b-455a-828c-859fa7d0976e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1501 microversion: 2.1 time: 0.162479 Aug 17 07:28:37.190668 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 110/214] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:37 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:37.210136 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-8c51d161-53cf-4b97-b930-1e457789fefc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6946268f-32e7-4a87-9bc5-6015c7adad14"}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:28:37.212390 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-8c51d161-53cf-4b97-b930-1e457789fefc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:37.219431 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8c51d161-53cf-4b97-b930-1e457789fefc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:37.219904 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8c51d161-53cf-4b97-b930-1e457789fefc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:37.220329 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8c51d161-53cf-4b97-b930-1e457789fefc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:37.221080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8c51d161-53cf-4b97-b930-1e457789fefc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:37.221607 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8c51d161-53cf-4b97-b930-1e457789fefc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:37.222050 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8c51d161-53cf-4b97-b930-1e457789fefc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:37.247926 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-8c51d161-53cf-4b97-b930-1e457789fefc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] HTTP exception thrown: Cannot 'attach_volume' instance 479d4f33-9d2a-4cec-84c9-18c739e2374f while it is in vm_state rescued Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-8c51d161-53cf-4b97-b930-1e457789fefc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Request method failure captured: Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: POST /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f/os-volume_attachments HTTP/1.1 Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 74 Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JhF5-28creqGjzJ0w0FxfPIBrCoALS6gQ2HtbOL3lJ0gLFx-dck1PDzbYwQcX2lNejuqyWG7p1bT6QmRlBuXmZgoEKIvihIfqvjPN4OpTNbaW9hBDO8GuDNGgy1UgRxXva9ZNQGdNRx4F3DMiBLL_i8w2oipQ2U63hj19PBJYA7bhU Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 177d0707c9d1494abc77c714e31fa15f Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-901876947 Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:28:37.249509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:28:37.251031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_177d0707c9d1494abc77c714e31fa15f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/177d0707c9d1494abc77c714e31fa15f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/177d0707c9d1494abc77c714e31fa15f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/177d0707c9d1494abc77c714e31fa15f"}]}] Aug 17 07:28:37.251031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-ServerRescueNegativeTestJSON-901876947 Aug 17 07:28:37.251031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 177d0707c9d1494abc77c714e31fa15f Aug 17 07:28:37.251031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-901876947 Aug 17 07:28:37.251031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-ServerRescueNegativeTestJSON-901876947-project Aug 17 07:28:37.251031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:28:37.251031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:28:37.251031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: be489ecec19847829df7c4488986373e Aug 17 07:28:37.251031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-ServerRescueNegativeTestJSON-901876947-project Aug 17 07:28:37.251031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Aug 17 07:28:37.251031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {"volumeAttachment": {"volumeId": "6946268f-32e7-4a87-9bc5-6015c7adad14"}} Aug 17 07:28:37.251031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Cannot 'attach_volume' instance 479d4f33-9d2a-4cec-84c9-18c739e2374f while it is in vm_state rescued Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'server_id': '479d4f33-9d2a-4cec-84c9-18c739e2374f', 'body': {'volumeAttachment': {'volumeId': '6946268f-32e7-4a87-9bc5-6015c7adad14'}}} Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 479d4f33-9d2a-4cec-84c9-18c739e2374f in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:28:37.252301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 479d4f33-9d2a-4cec-84c9-18c739e2374f while it is in vm_state rescued Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:28:37.254493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:28:37.256091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:28:37.256091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:28:37.256091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 479d4f33-9d2a-4cec-84c9-18c739e2374f while it is in vm_state rescued Aug 17 07:28:37.256091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:28:37.256091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-8c51d161-53cf-4b97-b930-1e457789fefc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Returning 409 to user: Cannot 'attach_volume' instance 479d4f33-9d2a-4cec-84c9-18c739e2374f while it is in vm_state rescued {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:28:37.256091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-8c51d161-53cf-4b97-b930-1e457789fefc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "POST /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044731 Aug 17 07:28:37.256091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 105/215] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 17 07:28:37 2022] POST /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 17 07:28:37.261933 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-6b92c480-b13d-4176-b653-4e25b105586f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:28:37.262587 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-6b92c480-b13d-4176-b653-4e25b105586f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:37.269589 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6b92c480-b13d-4176-b653-4e25b105586f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:37.270151 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6b92c480-b13d-4176-b653-4e25b105586f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:37.270594 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6b92c480-b13d-4176-b653-4e25b105586f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:37.271290 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6b92c480-b13d-4176-b653-4e25b105586f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:37.271748 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6b92c480-b13d-4176-b653-4e25b105586f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:37.272174 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6b92c480-b13d-4176-b653-4e25b105586f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:37.338165 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-6b92c480-b13d-4176-b653-4e25b105586f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "POST /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f/action" status: 202 len: 0 microversion: 2.1 time: 0.081026 Aug 17 07:28:37.342074 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 111/216] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 17 07:28:37 2022] POST /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:28:37.348140 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-678ea5c2-6a72-41a7-8042-747e2ae96d8d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:37.348758 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-678ea5c2-6a72-41a7-8042-747e2ae96d8d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:37.354966 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-678ea5c2-6a72-41a7-8042-747e2ae96d8d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:37.355452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-678ea5c2-6a72-41a7-8042-747e2ae96d8d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:37.355887 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-678ea5c2-6a72-41a7-8042-747e2ae96d8d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:37.356569 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-678ea5c2-6a72-41a7-8042-747e2ae96d8d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:37.357019 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-678ea5c2-6a72-41a7-8042-747e2ae96d8d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:37.357439 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-678ea5c2-6a72-41a7-8042-747e2ae96d8d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:37.487179 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-678ea5c2-6a72-41a7-8042-747e2ae96d8d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:37.495884 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-678ea5c2-6a72-41a7-8042-747e2ae96d8d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1509 microversion: 2.1 time: 0.151305 Aug 17 07:28:37.496494 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 106/217] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:37 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:38.524306 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b4713ec4-10a1-45b7-b051-874f2bf9829f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:38.525002 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-b4713ec4-10a1-45b7-b051-874f2bf9829f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:38.531989 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b4713ec4-10a1-45b7-b051-874f2bf9829f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:38.532510 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b4713ec4-10a1-45b7-b051-874f2bf9829f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:38.532941 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b4713ec4-10a1-45b7-b051-874f2bf9829f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:38.533625 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b4713ec4-10a1-45b7-b051-874f2bf9829f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:38.534108 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b4713ec4-10a1-45b7-b051-874f2bf9829f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:38.534528 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b4713ec4-10a1-45b7-b051-874f2bf9829f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:38.698325 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b4713ec4-10a1-45b7-b051-874f2bf9829f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:38.706294 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b4713ec4-10a1-45b7-b051-874f2bf9829f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1509 microversion: 2.1 time: 0.192025 Aug 17 07:28:38.706824 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 112/218] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:38 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1509 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:39.728948 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ee34fd81-02fd-4c6b-ab97-ac92ee98295d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:39.729603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ee34fd81-02fd-4c6b-ab97-ac92ee98295d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:39.736168 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee34fd81-02fd-4c6b-ab97-ac92ee98295d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:39.736640 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee34fd81-02fd-4c6b-ab97-ac92ee98295d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:39.737078 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee34fd81-02fd-4c6b-ab97-ac92ee98295d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:39.737762 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee34fd81-02fd-4c6b-ab97-ac92ee98295d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:39.738241 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee34fd81-02fd-4c6b-ab97-ac92ee98295d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:39.738655 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee34fd81-02fd-4c6b-ab97-ac92ee98295d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:39.890419 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ee34fd81-02fd-4c6b-ab97-ac92ee98295d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:39.897881 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ee34fd81-02fd-4c6b-ab97-ac92ee98295d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1509 microversion: 2.1 time: 0.174187 Aug 17 07:28:39.898664 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 107/219] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:39 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:40.919682 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-f6072066-32f4-4cfb-b27b-520a4593992d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:40.920861 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-f6072066-32f4-4cfb-b27b-520a4593992d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:40.927143 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f6072066-32f4-4cfb-b27b-520a4593992d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:40.927819 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f6072066-32f4-4cfb-b27b-520a4593992d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:40.928273 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f6072066-32f4-4cfb-b27b-520a4593992d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:40.929133 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f6072066-32f4-4cfb-b27b-520a4593992d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:40.929746 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f6072066-32f4-4cfb-b27b-520a4593992d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:40.930206 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f6072066-32f4-4cfb-b27b-520a4593992d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:41.022585 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-078f0b50-5cab-4fd6-a218-76ca3a8776e4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:41.023223 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-078f0b50-5cab-4fd6-a218-76ca3a8776e4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:41.030323 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-078f0b50-5cab-4fd6-a218-76ca3a8776e4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:41.030807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-078f0b50-5cab-4fd6-a218-76ca3a8776e4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:41.031414 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-078f0b50-5cab-4fd6-a218-76ca3a8776e4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:41.032109 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-078f0b50-5cab-4fd6-a218-76ca3a8776e4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:41.032561 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-078f0b50-5cab-4fd6-a218-76ca3a8776e4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:41.032985 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-078f0b50-5cab-4fd6-a218-76ca3a8776e4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:41.051849 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=89 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:41.064583 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-078f0b50-5cab-4fd6-a218-76ca3a8776e4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6/ips" status: 200 len: 150 microversion: 2.20 time: 0.045854 Aug 17 07:28:41.065614 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 108/220] 10.222.0.45 () {60 vars in 1289 bytes} [Wed Aug 17 07:28:41 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 07:28:41.077584 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-f6072066-32f4-4cfb-b27b-520a4593992d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:41.085044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-f6072066-32f4-4cfb-b27b-520a4593992d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1515 microversion: 2.1 time: 0.169117 Aug 17 07:28:41.085770 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 113/221] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:40 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:42.514804 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-3979e530-c968-40d5-a3d7-872e55f88523 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Action: 'create', calling method: .version_select at 0x7f30ac56e670>, body: {"keypair": {"name": "tempest-keypair-485856723", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+i6ZFv9pJpFnxi34DuhErt11mgRlGgtmvf6RoOfvpV5zh+/oiG5jOSz4tBk/FWavRRMrYw7B9PK2mDYop4Of9XKZjQFb+CeGkqm3SxwPnHA2shIm++KC9U9yoW3FFI+g=="}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:28:42.532386 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-3979e530-c968-40d5-a3d7-872e55f88523 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Getting quotas for project 177d0707c9d1494abc77c714e31fa15f. Resources: {'key_pairs'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:28:42.536428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-3979e530-c968-40d5-a3d7-872e55f88523 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Getting quotas for user be489ecec19847829df7c4488986373e and project 177d0707c9d1494abc77c714e31fa15f. Resources: {'key_pairs'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:28:42.563012 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-3979e530-c968-40d5-a3d7-872e55f88523 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053744 Aug 17 07:28:42.563669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 109/222] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 17 07:28:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:28:43.983267 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c706f12c-c790-4770-bedd-40221f308405 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:43.983754 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-c706f12c-c790-4770-bedd-40221f308405 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:43.990087 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c706f12c-c790-4770-bedd-40221f308405 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:43.990618 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c706f12c-c790-4770-bedd-40221f308405 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:43.991060 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c706f12c-c790-4770-bedd-40221f308405 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:43.991755 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c706f12c-c790-4770-bedd-40221f308405 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:43.992467 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c706f12c-c790-4770-bedd-40221f308405 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:43.992892 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c706f12c-c790-4770-bedd-40221f308405 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:44.018286 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-c706f12c-c790-4770-bedd-40221f308405 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22/ips" status: 200 len: 145 microversion: 2.1 time: 0.038888 Aug 17 07:28:44.019221 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 114/223] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 17 07:28:43 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:28:44.052946 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f63c241d-5707-427f-9e55-389a258ef05b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1357550008", "imageRef": "37843ca7-b19a-44f1-acf3-e9432324d4b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "198cd0ce-2e6c-40dc-aae4-0071ce2ee0e2"}], "security_groups": [{"name": "tempest-securitygroup--1319037927"}], "key_name": "tempest-keypair-485856723", "user_data": "}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:28:44.339178 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-85161673-9daa-430b-bb19-0f354df854e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:28:44.339716 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-85161673-9daa-430b-bb19-0f354df854e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:44.346714 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-85161673-9daa-430b-bb19-0f354df854e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:44.347200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-85161673-9daa-430b-bb19-0f354df854e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:44.347807 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-85161673-9daa-430b-bb19-0f354df854e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:44.348508 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-85161673-9daa-430b-bb19-0f354df854e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:44.348960 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-85161673-9daa-430b-bb19-0f354df854e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:44.349382 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-85161673-9daa-430b-bb19-0f354df854e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:44.377921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.objects.instance [None req-85161673-9daa-430b-bb19-0f354df854e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lazy-loading 'flavor' on Instance uuid 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 {{(pid=120835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:28:45.747957 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.network.neutron [None req-f63c241d-5707-427f-9e55-389a258ef05b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] validate_networks() for [('198cd0ce-2e6c-40dc-aae4-0071ce2ee0e2', None, None, None, None, None)] {{(pid=120834) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:28:45.791257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-85161673-9daa-430b-bb19-0f354df854e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "POST /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6/action" status: 202 len: 0 microversion: 2.20 time: 1.455790 Aug 17 07:28:45.792442 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 115/224] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 17 07:28:44 2022] POST /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6/action => generated 0 bytes in 1458 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 17 07:28:45.798993 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-8d343e57-8708-4b00-b5e4-fb06e8594830 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:45.799656 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-8d343e57-8708-4b00-b5e4-fb06e8594830 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:45.806357 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8d343e57-8708-4b00-b5e4-fb06e8594830 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:45.806806 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8d343e57-8708-4b00-b5e4-fb06e8594830 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:45.807241 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8d343e57-8708-4b00-b5e4-fb06e8594830 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:45.808105 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8d343e57-8708-4b00-b5e4-fb06e8594830 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:45.808709 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8d343e57-8708-4b00-b5e4-fb06e8594830 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:45.809372 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8d343e57-8708-4b00-b5e4-fb06e8594830 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:45.855615 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-8d343e57-8708-4b00-b5e4-fb06e8594830 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f/ips" status: 200 len: 149 microversion: 2.1 time: 0.061548 Aug 17 07:28:45.858579 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 116/225] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 17 07:28:45 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f/ips => generated 149 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:28:45.865876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c6373346-a350-4115-a97f-4f948f4d8732 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:45.865876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-c6373346-a350-4115-a97f-4f948f4d8732 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:45.881763 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c6373346-a350-4115-a97f-4f948f4d8732 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:45.882296 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c6373346-a350-4115-a97f-4f948f4d8732 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:45.882739 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c6373346-a350-4115-a97f-4f948f4d8732 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:45.887783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c6373346-a350-4115-a97f-4f948f4d8732 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:45.888344 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c6373346-a350-4115-a97f-4f948f4d8732 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:45.888746 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c6373346-a350-4115-a97f-4f948f4d8732 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:46.143708 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c6373346-a350-4115-a97f-4f948f4d8732 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:46.153659 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c6373346-a350-4115-a97f-4f948f4d8732 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:46.156155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c6373346-a350-4115-a97f-4f948f4d8732 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:46.157794 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-c6373346-a350-4115-a97f-4f948f4d8732 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.300183 Aug 17 07:28:46.165868 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 117/226] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:28:45 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:28:46.272096 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-f63c241d-5707-427f-9e55-389a258ef05b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Flavor limits 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:28:46.272541 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-f63c241d-5707-427f-9e55-389a258ef05b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Image limits 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:28:46.273008 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-f63c241d-5707-427f-9e55-389a258ef05b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Flavor pref 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:28:46.273409 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-f63c241d-5707-427f-9e55-389a258ef05b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Image pref 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:28:46.273813 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-f63c241d-5707-427f-9e55-389a258ef05b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:28:46.288162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f63c241d-5707-427f-9e55-389a258ef05b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:46.288638 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f63c241d-5707-427f-9e55-389a258ef05b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:46.289068 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f63c241d-5707-427f-9e55-389a258ef05b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:46.289818 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f63c241d-5707-427f-9e55-389a258ef05b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:46.290334 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f63c241d-5707-427f-9e55-389a258ef05b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:46.290712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f63c241d-5707-427f-9e55-389a258ef05b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:46.307624 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-f63c241d-5707-427f-9e55-389a258ef05b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Getting quotas for project 177d0707c9d1494abc77c714e31fa15f. Resources: {'ram', 'cores', 'instances'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:28:46.311558 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-f63c241d-5707-427f-9e55-389a258ef05b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Getting quotas for user be489ecec19847829df7c4488986373e and project 177d0707c9d1494abc77c714e31fa15f. Resources: {'ram', 'cores', 'instances'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:28:46.323182 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f63c241d-5707-427f-9e55-389a258ef05b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Going to run 1 instances... {{(pid=120834) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:28:46.325605 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f63c241d-5707-427f-9e55-389a258ef05b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37843ca7-b19a-44f1-acf3-e9432324d4b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120834) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:28:46.373164 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f63c241d-5707-427f-9e55-389a258ef05b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.324968 Aug 17 07:28:46.374082 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 110/227] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:28:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 2326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 07:28:46.385804 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-54e993b6-b35f-453b-ac13-8137eb6237d5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:46.388323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-54e993b6-b35f-453b-ac13-8137eb6237d5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:46.453743 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-54e993b6-b35f-453b-ac13-8137eb6237d5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:46.460753 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-54e993b6-b35f-453b-ac13-8137eb6237d5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1245 microversion: 2.1 time: 0.079571 Aug 17 07:28:46.461322 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 118/228] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:46 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:47.189407 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-abe8529a-8f5e-4853-95f7-5d8e82fca62a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:47.190864 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-abe8529a-8f5e-4853-95f7-5d8e82fca62a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:47.197120 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-abe8529a-8f5e-4853-95f7-5d8e82fca62a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:47.197625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-abe8529a-8f5e-4853-95f7-5d8e82fca62a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:47.198297 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-abe8529a-8f5e-4853-95f7-5d8e82fca62a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:47.202514 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-abe8529a-8f5e-4853-95f7-5d8e82fca62a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:47.202989 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-abe8529a-8f5e-4853-95f7-5d8e82fca62a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:47.203424 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-abe8529a-8f5e-4853-95f7-5d8e82fca62a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:47.397201 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-abe8529a-8f5e-4853-95f7-5d8e82fca62a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:47.407401 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-909552f4-9733-4c63-9f52-d38a644d157c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d50b1d8d-0e26-44b9-8b24-0844730aa827"}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:28:47.409732 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-909552f4-9733-4c63-9f52-d38a644d157c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:47.415382 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-abe8529a-8f5e-4853-95f7-5d8e82fca62a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:47.417159 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-abe8529a-8f5e-4853-95f7-5d8e82fca62a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:47.418494 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-abe8529a-8f5e-4853-95f7-5d8e82fca62a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.234644 Aug 17 07:28:47.422005 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 111/229] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:28:47 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:28:47.422263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-909552f4-9733-4c63-9f52-d38a644d157c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:47.422375 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-909552f4-9733-4c63-9f52-d38a644d157c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:47.422745 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-909552f4-9733-4c63-9f52-d38a644d157c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:47.423452 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-909552f4-9733-4c63-9f52-d38a644d157c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:47.423911 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-909552f4-9733-4c63-9f52-d38a644d157c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:47.424339 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-909552f4-9733-4c63-9f52-d38a644d157c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:47.486081 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-cf920fd2-2bde-4ce2-a3f9-6dfd61ba9bfc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:47.486873 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-cf920fd2-2bde-4ce2-a3f9-6dfd61ba9bfc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:47.502009 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cf920fd2-2bde-4ce2-a3f9-6dfd61ba9bfc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:47.506241 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cf920fd2-2bde-4ce2-a3f9-6dfd61ba9bfc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:47.506852 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cf920fd2-2bde-4ce2-a3f9-6dfd61ba9bfc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:47.507920 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cf920fd2-2bde-4ce2-a3f9-6dfd61ba9bfc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:47.508610 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cf920fd2-2bde-4ce2-a3f9-6dfd61ba9bfc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:47.510253 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cf920fd2-2bde-4ce2-a3f9-6dfd61ba9bfc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:47.729608 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-cf920fd2-2bde-4ce2-a3f9-6dfd61ba9bfc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:47.738362 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-cf920fd2-2bde-4ce2-a3f9-6dfd61ba9bfc tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1297 microversion: 2.1 time: 0.257029 Aug 17 07:28:47.738945 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 112/230] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:47 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1297 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:28:47.809844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-909552f4-9733-4c63-9f52-d38a644d157c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "POST /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.410064 Aug 17 07:28:47.810524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 119/231] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 17 07:28:47 2022] POST /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f/os-volume_attachments => generated 194 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:28:48.445831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-780832d9-e897-43e0-b2f0-15af68ecc6cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:48.446838 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-780832d9-e897-43e0-b2f0-15af68ecc6cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:48.461210 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-780832d9-e897-43e0-b2f0-15af68ecc6cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:48.462066 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-780832d9-e897-43e0-b2f0-15af68ecc6cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:48.462846 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-780832d9-e897-43e0-b2f0-15af68ecc6cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:48.466501 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-780832d9-e897-43e0-b2f0-15af68ecc6cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:48.467687 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-780832d9-e897-43e0-b2f0-15af68ecc6cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:48.468284 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-780832d9-e897-43e0-b2f0-15af68ecc6cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:48.527874 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9916f1a0-eb8a-40a7-a44f-d4fcf4d35627 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e321076-d259-485a-a13f-a83e2045a2f0"}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:28:48.531662 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-9916f1a0-eb8a-40a7-a44f-d4fcf4d35627 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:48.539243 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9916f1a0-eb8a-40a7-a44f-d4fcf4d35627 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:48.541678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9916f1a0-eb8a-40a7-a44f-d4fcf4d35627 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:48.542373 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9916f1a0-eb8a-40a7-a44f-d4fcf4d35627 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:48.543306 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9916f1a0-eb8a-40a7-a44f-d4fcf4d35627 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:48.544003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9916f1a0-eb8a-40a7-a44f-d4fcf4d35627 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:48.544646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9916f1a0-eb8a-40a7-a44f-d4fcf4d35627 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:48.670629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-780832d9-e897-43e0-b2f0-15af68ecc6cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:48.691276 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-780832d9-e897-43e0-b2f0-15af68ecc6cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:48.693607 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-780832d9-e897-43e0-b2f0-15af68ecc6cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:48.695287 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-780832d9-e897-43e0-b2f0-15af68ecc6cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.254597 Aug 17 07:28:48.695846 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 113/232] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:28:48 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:28:48.762935 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-00ed019f-5f9d-47d0-b3b3-cf08ce6de754 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:48.766071 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-00ed019f-5f9d-47d0-b3b3-cf08ce6de754 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:48.773247 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-00ed019f-5f9d-47d0-b3b3-cf08ce6de754 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:48.773906 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-00ed019f-5f9d-47d0-b3b3-cf08ce6de754 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:48.774673 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-00ed019f-5f9d-47d0-b3b3-cf08ce6de754 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:48.775592 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-00ed019f-5f9d-47d0-b3b3-cf08ce6de754 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:48.776240 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-00ed019f-5f9d-47d0-b3b3-cf08ce6de754 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:48.777011 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-00ed019f-5f9d-47d0-b3b3-cf08ce6de754 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:48.945108 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-00ed019f-5f9d-47d0-b3b3-cf08ce6de754 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:48.954380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-00ed019f-5f9d-47d0-b3b3-cf08ce6de754 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1371 microversion: 2.1 time: 0.195377 Aug 17 07:28:48.969652 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 114/233] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:48 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:49.014556 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-9916f1a0-eb8a-40a7-a44f-d4fcf4d35627 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "POST /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490753 Aug 17 07:28:49.020782 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 120/234] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 17 07:28:48 2022] POST /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22/os-volume_attachments => generated 194 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:28:49.414851 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-2ea305ac-4959-458a-8d74-9ad1d3b69ba3 req-85c0da0e-a20f-40e4-a723-ae9261a0f19a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f58c6a6-fa9c-4795-97c2-525c1510124b", "tag": "0799a736-86ba-40d5-8200-f99f2281e899"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:28:49.439015 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-2ea305ac-4959-458a-8d74-9ad1d3b69ba3 req-85c0da0e-a20f-40e4-a723-ae9261a0f19a service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:49.439765 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-2ea305ac-4959-458a-8d74-9ad1d3b69ba3 req-85c0da0e-a20f-40e4-a723-ae9261a0f19a service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:49.441709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-2ea305ac-4959-458a-8d74-9ad1d3b69ba3 req-85c0da0e-a20f-40e4-a723-ae9261a0f19a service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:49.453422 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-2ea305ac-4959-458a-8d74-9ad1d3b69ba3 req-85c0da0e-a20f-40e4-a723-ae9261a0f19a service nova] Creating event network-changed:0799a736-86ba-40d5-8200-f99f2281e899 for instance 1f58c6a6-fa9c-4795-97c2-525c1510124b on hv-cinder-85312 Aug 17 07:28:49.458729 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-2ea305ac-4959-458a-8d74-9ad1d3b69ba3 req-85c0da0e-a20f-40e4-a723-ae9261a0f19a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053396 Aug 17 07:28:49.459465 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 115/235] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:28:49.723233 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a9aca77e-4791-4273-898d-df37af6f5a62 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:49.724208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a9aca77e-4791-4273-898d-df37af6f5a62 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:49.733798 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a9aca77e-4791-4273-898d-df37af6f5a62 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:49.734516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a9aca77e-4791-4273-898d-df37af6f5a62 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:49.734950 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a9aca77e-4791-4273-898d-df37af6f5a62 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:49.735658 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a9aca77e-4791-4273-898d-df37af6f5a62 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:49.736117 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a9aca77e-4791-4273-898d-df37af6f5a62 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:49.736541 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a9aca77e-4791-4273-898d-df37af6f5a62 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:49.891092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a9aca77e-4791-4273-898d-df37af6f5a62 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:49.899183 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a9aca77e-4791-4273-898d-df37af6f5a62 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:49.900696 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a9aca77e-4791-4273-898d-df37af6f5a62 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:49.901858 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a9aca77e-4791-4273-898d-df37af6f5a62 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.185030 Aug 17 07:28:49.902485 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 121/236] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:28:49 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:28:49.976682 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-451ff5f2-13ae-4ec5-b835-aa336aab0f53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:49.977556 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-451ff5f2-13ae-4ec5-b835-aa336aab0f53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:49.984052 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-451ff5f2-13ae-4ec5-b835-aa336aab0f53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:49.984536 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-451ff5f2-13ae-4ec5-b835-aa336aab0f53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:49.984975 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-451ff5f2-13ae-4ec5-b835-aa336aab0f53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:49.985719 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-451ff5f2-13ae-4ec5-b835-aa336aab0f53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:49.986201 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-451ff5f2-13ae-4ec5-b835-aa336aab0f53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:49.986690 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-451ff5f2-13ae-4ec5-b835-aa336aab0f53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:50.130938 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-451ff5f2-13ae-4ec5-b835-aa336aab0f53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:50.138632 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-451ff5f2-13ae-4ec5-b835-aa336aab0f53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1371 microversion: 2.1 time: 0.166293 Aug 17 07:28:50.139202 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 116/237] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:49 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:28:50.925214 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-fab1f5fe-09e8-4d1a-bd00-5fc923adfbf1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:50.925817 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-fab1f5fe-09e8-4d1a-bd00-5fc923adfbf1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:50.932245 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fab1f5fe-09e8-4d1a-bd00-5fc923adfbf1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:50.932722 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fab1f5fe-09e8-4d1a-bd00-5fc923adfbf1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:50.933153 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fab1f5fe-09e8-4d1a-bd00-5fc923adfbf1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:50.933833 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fab1f5fe-09e8-4d1a-bd00-5fc923adfbf1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:50.934307 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fab1f5fe-09e8-4d1a-bd00-5fc923adfbf1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:50.934729 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fab1f5fe-09e8-4d1a-bd00-5fc923adfbf1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:51.068726 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-fab1f5fe-09e8-4d1a-bd00-5fc923adfbf1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:51.071127 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:51.079007 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-fab1f5fe-09e8-4d1a-bd00-5fc923adfbf1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:51.083175 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-fab1f5fe-09e8-4d1a-bd00-5fc923adfbf1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:51.084367 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-fab1f5fe-09e8-4d1a-bd00-5fc923adfbf1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.162968 Aug 17 07:28:51.085215 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 122/238] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:28:50 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:28:51.159230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-fc76226a-c772-44fb-9fda-5e5842873c49 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:51.159833 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-fc76226a-c772-44fb-9fda-5e5842873c49 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:51.166293 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fc76226a-c772-44fb-9fda-5e5842873c49 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:51.166764 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fc76226a-c772-44fb-9fda-5e5842873c49 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:51.167193 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fc76226a-c772-44fb-9fda-5e5842873c49 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:51.167867 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fc76226a-c772-44fb-9fda-5e5842873c49 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:51.168310 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fc76226a-c772-44fb-9fda-5e5842873c49 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:51.168727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fc76226a-c772-44fb-9fda-5e5842873c49 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:51.320076 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-fc76226a-c772-44fb-9fda-5e5842873c49 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:51.327997 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-fc76226a-c772-44fb-9fda-5e5842873c49 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1371 microversion: 2.1 time: 0.172518 Aug 17 07:28:51.328892 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 117/239] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:51 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:52.108978 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3556f97a-5362-4903-8d7a-b96580ebfb9e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:52.109604 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-3556f97a-5362-4903-8d7a-b96580ebfb9e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:52.116697 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3556f97a-5362-4903-8d7a-b96580ebfb9e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:52.117431 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3556f97a-5362-4903-8d7a-b96580ebfb9e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:52.117859 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3556f97a-5362-4903-8d7a-b96580ebfb9e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:52.118576 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3556f97a-5362-4903-8d7a-b96580ebfb9e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:52.119021 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3556f97a-5362-4903-8d7a-b96580ebfb9e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:52.119449 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3556f97a-5362-4903-8d7a-b96580ebfb9e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:52.257274 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3556f97a-5362-4903-8d7a-b96580ebfb9e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:52.266640 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3556f97a-5362-4903-8d7a-b96580ebfb9e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:52.268035 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3556f97a-5362-4903-8d7a-b96580ebfb9e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:52.269198 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-3556f97a-5362-4903-8d7a-b96580ebfb9e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.165482 Aug 17 07:28:52.269836 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 123/240] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:28:52 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:28:52.349982 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-75f3e474-2d28-4233-b0a5-023eb8e77cb2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:52.350750 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-75f3e474-2d28-4233-b0a5-023eb8e77cb2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:52.358864 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-75f3e474-2d28-4233-b0a5-023eb8e77cb2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:52.359438 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-75f3e474-2d28-4233-b0a5-023eb8e77cb2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:52.360247 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-75f3e474-2d28-4233-b0a5-023eb8e77cb2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:52.361058 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-75f3e474-2d28-4233-b0a5-023eb8e77cb2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:52.361573 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-75f3e474-2d28-4233-b0a5-023eb8e77cb2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:52.362085 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-75f3e474-2d28-4233-b0a5-023eb8e77cb2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:52.499515 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-75f3e474-2d28-4233-b0a5-023eb8e77cb2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:52.508195 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-75f3e474-2d28-4233-b0a5-023eb8e77cb2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1371 microversion: 2.1 time: 0.163086 Aug 17 07:28:52.508763 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 118/241] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:52 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:52.756593 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-689ff811-f668-4805-afa8-c74fcf05d47b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-930561378", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-800034190", "security_groups": [{"name": "tempest-secgroup-smoke-563096334"}], "block_device_mapping_v2": [{"uuid": "6b97012a-cb13-4933-a8b7-d64e2816586f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7da685da-5755-4a74-ae7f-f5d4d0aa3b15"}]}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:28:52.881327 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.network.neutron [None req-689ff811-f668-4805-afa8-c74fcf05d47b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] validate_networks() for [('7da685da-5755-4a74-ae7f-f5d4d0aa3b15', None, None, None, None, None)] {{(pid=120835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:28:53.277534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-689ff811-f668-4805-afa8-c74fcf05d47b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Flavor limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:28:53.278087 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-689ff811-f668-4805-afa8-c74fcf05d47b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Image limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:28:53.278461 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-689ff811-f668-4805-afa8-c74fcf05d47b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Flavor pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:28:53.278903 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-689ff811-f668-4805-afa8-c74fcf05d47b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Image pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:28:53.279356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-689ff811-f668-4805-afa8-c74fcf05d47b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:28:53.289370 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-689ff811-f668-4805-afa8-c74fcf05d47b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:53.289859 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-689ff811-f668-4805-afa8-c74fcf05d47b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:53.290329 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-689ff811-f668-4805-afa8-c74fcf05d47b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:53.291252 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-689ff811-f668-4805-afa8-c74fcf05d47b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:53.291715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-689ff811-f668-4805-afa8-c74fcf05d47b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:53.292188 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-689ff811-f668-4805-afa8-c74fcf05d47b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:53.293279 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-84294f95-b9f0-4dcd-b8b0-b318695be0d7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:53.294105 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-84294f95-b9f0-4dcd-b8b0-b318695be0d7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:53.301013 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-84294f95-b9f0-4dcd-b8b0-b318695be0d7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:53.301495 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-84294f95-b9f0-4dcd-b8b0-b318695be0d7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:53.302340 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-84294f95-b9f0-4dcd-b8b0-b318695be0d7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:53.303001 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-84294f95-b9f0-4dcd-b8b0-b318695be0d7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:53.303487 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-84294f95-b9f0-4dcd-b8b0-b318695be0d7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:53.304233 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-84294f95-b9f0-4dcd-b8b0-b318695be0d7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:53.314064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-689ff811-f668-4805-afa8-c74fcf05d47b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Getting quotas for project afb93daca17c466da3a698536c6b323f. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:28:53.319042 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-689ff811-f668-4805-afa8-c74fcf05d47b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Getting quotas for user b2e79830079c4aa9b95c4622bac45c74 and project afb93daca17c466da3a698536c6b323f. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:28:53.399522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-689ff811-f668-4805-afa8-c74fcf05d47b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Going to run 1 instances... {{(pid=120835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:28:53.401730 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-689ff811-f668-4805-afa8-c74fcf05d47b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b97012a-cb13-4933-a8b7-d64e2816586f',volume_size=None,volume_type=None)] {{(pid=120835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:28:53.460269 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-84294f95-b9f0-4dcd-b8b0-b318695be0d7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:53.469428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-84294f95-b9f0-4dcd-b8b0-b318695be0d7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:53.471135 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-84294f95-b9f0-4dcd-b8b0-b318695be0d7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:53.472576 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-84294f95-b9f0-4dcd-b8b0-b318695be0d7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.183778 Aug 17 07:28:53.488982 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 119/242] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:28:53 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:28:53.530613 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-61bc343c-52d9-4b91-9ee4-d46c44cab1d2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:53.531218 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-61bc343c-52d9-4b91-9ee4-d46c44cab1d2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:53.538545 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-689ff811-f668-4805-afa8-c74fcf05d47b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.785548 Aug 17 07:28:53.539251 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 124/243] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:28:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 07:28:53.548430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-61bc343c-52d9-4b91-9ee4-d46c44cab1d2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:53.549178 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-61bc343c-52d9-4b91-9ee4-d46c44cab1d2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:53.549801 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-61bc343c-52d9-4b91-9ee4-d46c44cab1d2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:53.550951 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-61bc343c-52d9-4b91-9ee4-d46c44cab1d2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:53.551596 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-61bc343c-52d9-4b91-9ee4-d46c44cab1d2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:53.551847 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d0a4cf42-dd5e-4d50-b21a-361ba5050a98 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:53.552022 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-61bc343c-52d9-4b91-9ee4-d46c44cab1d2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:53.553791 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d0a4cf42-dd5e-4d50-b21a-361ba5050a98 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:53.637834 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d0a4cf42-dd5e-4d50-b21a-361ba5050a98 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:53.650040 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d0a4cf42-dd5e-4d50-b21a-361ba5050a98 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1093 microversion: 2.1 time: 0.101599 Aug 17 07:28:53.650656 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 125/244] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:53 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1093 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:53.794250 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-61bc343c-52d9-4b91-9ee4-d46c44cab1d2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:53.802120 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-61bc343c-52d9-4b91-9ee4-d46c44cab1d2 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1371 microversion: 2.1 time: 0.276080 Aug 17 07:28:53.802693 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 120/245] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:53 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:28:54.496825 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-4bc4d312-ca36-4c95-a0a6-dbdf5f67ad2a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:54.497406 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-4bc4d312-ca36-4c95-a0a6-dbdf5f67ad2a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:54.504005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4bc4d312-ca36-4c95-a0a6-dbdf5f67ad2a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:54.504473 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4bc4d312-ca36-4c95-a0a6-dbdf5f67ad2a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:54.504897 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4bc4d312-ca36-4c95-a0a6-dbdf5f67ad2a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:54.505570 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4bc4d312-ca36-4c95-a0a6-dbdf5f67ad2a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:54.506040 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4bc4d312-ca36-4c95-a0a6-dbdf5f67ad2a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:54.506457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4bc4d312-ca36-4c95-a0a6-dbdf5f67ad2a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:54.636353 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-4bc4d312-ca36-4c95-a0a6-dbdf5f67ad2a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:54.645018 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-4bc4d312-ca36-4c95-a0a6-dbdf5f67ad2a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:54.646574 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-4bc4d312-ca36-4c95-a0a6-dbdf5f67ad2a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:54.647722 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-4bc4d312-ca36-4c95-a0a6-dbdf5f67ad2a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.154800 Aug 17 07:28:54.648282 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 126/246] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:28:54 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:28:54.674526 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-de9a56c9-5288-4459-a2a4-81762c5c1cd9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:54.675170 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-de9a56c9-5288-4459-a2a4-81762c5c1cd9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:54.677541 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:54.682676 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-de9a56c9-5288-4459-a2a4-81762c5c1cd9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:54.683146 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-de9a56c9-5288-4459-a2a4-81762c5c1cd9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:54.683577 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-de9a56c9-5288-4459-a2a4-81762c5c1cd9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:54.684258 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-de9a56c9-5288-4459-a2a4-81762c5c1cd9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:54.684708 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-de9a56c9-5288-4459-a2a4-81762c5c1cd9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:54.685134 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-de9a56c9-5288-4459-a2a4-81762c5c1cd9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:54.748444 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-de9a56c9-5288-4459-a2a4-81762c5c1cd9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:54.756132 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-de9a56c9-5288-4459-a2a4-81762c5c1cd9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1143 microversion: 2.1 time: 0.085412 Aug 17 07:28:54.756684 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 121/247] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:54 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:54.823475 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-bfe5f1b7-70ec-41cc-a5df-6a35a594b167 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:54.824132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-bfe5f1b7-70ec-41cc-a5df-6a35a594b167 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:54.830558 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bfe5f1b7-70ec-41cc-a5df-6a35a594b167 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:54.831032 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bfe5f1b7-70ec-41cc-a5df-6a35a594b167 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:54.831454 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bfe5f1b7-70ec-41cc-a5df-6a35a594b167 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:54.832784 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bfe5f1b7-70ec-41cc-a5df-6a35a594b167 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:54.833236 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bfe5f1b7-70ec-41cc-a5df-6a35a594b167 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:54.833657 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bfe5f1b7-70ec-41cc-a5df-6a35a594b167 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:54.981657 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-bfe5f1b7-70ec-41cc-a5df-6a35a594b167 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:54.989102 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-bfe5f1b7-70ec-41cc-a5df-6a35a594b167 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1371 microversion: 2.1 time: 0.169600 Aug 17 07:28:54.989671 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 127/248] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:54 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:55.171822 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-ed1f18e2-838c-4201-8c3a-241a84237fb4 req-ca2d059d-31a6-4dbb-91f3-2e2848a0faa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f58c6a6-fa9c-4795-97c2-525c1510124b", "name": "network-vif-plugged", "status": "completed", "tag": "0799a736-86ba-40d5-8200-f99f2281e899"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:28:55.183177 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-ed1f18e2-838c-4201-8c3a-241a84237fb4 req-ca2d059d-31a6-4dbb-91f3-2e2848a0faa7 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:55.183888 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-ed1f18e2-838c-4201-8c3a-241a84237fb4 req-ca2d059d-31a6-4dbb-91f3-2e2848a0faa7 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:55.184589 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-ed1f18e2-838c-4201-8c3a-241a84237fb4 req-ca2d059d-31a6-4dbb-91f3-2e2848a0faa7 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:55.197097 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-ed1f18e2-838c-4201-8c3a-241a84237fb4 req-ca2d059d-31a6-4dbb-91f3-2e2848a0faa7 service nova] Creating event network-vif-plugged:0799a736-86ba-40d5-8200-f99f2281e899 for instance 1f58c6a6-fa9c-4795-97c2-525c1510124b on hv-cinder-85312 Aug 17 07:28:55.203723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-ed1f18e2-838c-4201-8c3a-241a84237fb4 req-ca2d059d-31a6-4dbb-91f3-2e2848a0faa7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035716 Aug 17 07:28:55.204594 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 122/249] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:28:55.673202 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-cd297b1d-f03b-4728-bd62-72f1cca67294 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:55.674368 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-cd297b1d-f03b-4728-bd62-72f1cca67294 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:55.676623 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:55.682604 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-cd297b1d-f03b-4728-bd62-72f1cca67294 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:55.683082 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-cd297b1d-f03b-4728-bd62-72f1cca67294 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:55.683519 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-cd297b1d-f03b-4728-bd62-72f1cca67294 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:55.684213 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-cd297b1d-f03b-4728-bd62-72f1cca67294 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:55.684663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-cd297b1d-f03b-4728-bd62-72f1cca67294 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:55.685125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-cd297b1d-f03b-4728-bd62-72f1cca67294 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:55.780605 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-47e51425-788d-40a5-9b67-2c11fb118c1e tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:55.782090 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-47e51425-788d-40a5-9b67-2c11fb118c1e tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:55.789002 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-47e51425-788d-40a5-9b67-2c11fb118c1e tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:55.789557 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-47e51425-788d-40a5-9b67-2c11fb118c1e tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:55.790247 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-47e51425-788d-40a5-9b67-2c11fb118c1e tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:55.790945 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-47e51425-788d-40a5-9b67-2c11fb118c1e tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:55.791627 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-47e51425-788d-40a5-9b67-2c11fb118c1e tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:55.792353 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-47e51425-788d-40a5-9b67-2c11fb118c1e tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:55.843930 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-cd297b1d-f03b-4728-bd62-72f1cca67294 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:55.857831 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-cd297b1d-f03b-4728-bd62-72f1cca67294 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:55.860292 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-cd297b1d-f03b-4728-bd62-72f1cca67294 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:55.862072 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-cd297b1d-f03b-4728-bd62-72f1cca67294 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.194665 Aug 17 07:28:55.874038 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-47e51425-788d-40a5-9b67-2c11fb118c1e tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:55.874038 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-47e51425-788d-40a5-9b67-2c11fb118c1e tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1143 microversion: 2.1 time: 0.097247 Aug 17 07:28:55.874038 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 123/250] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:55 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1143 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:28:55.874983 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 128/251] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:28:55 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:28:56.010715 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-35409647-28f6-4bf6-a878-07b9fac25136 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:56.011322 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-35409647-28f6-4bf6-a878-07b9fac25136 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:56.017980 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-35409647-28f6-4bf6-a878-07b9fac25136 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:56.018466 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-35409647-28f6-4bf6-a878-07b9fac25136 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:56.018992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-35409647-28f6-4bf6-a878-07b9fac25136 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:56.019565 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-35409647-28f6-4bf6-a878-07b9fac25136 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:56.020167 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-35409647-28f6-4bf6-a878-07b9fac25136 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:56.020589 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-35409647-28f6-4bf6-a878-07b9fac25136 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:56.157866 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-35409647-28f6-4bf6-a878-07b9fac25136 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:56.165419 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-35409647-28f6-4bf6-a878-07b9fac25136 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1371 microversion: 2.1 time: 0.158395 Aug 17 07:28:56.166124 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 124/252] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:56 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:56.886462 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d6e571c2-3cb0-4834-8d72-26da857acdac tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:56.888888 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d6e571c2-3cb0-4834-8d72-26da857acdac tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:56.893478 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d6e571c2-3cb0-4834-8d72-26da857acdac tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:56.893953 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d6e571c2-3cb0-4834-8d72-26da857acdac tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:56.894171 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-fd434c52-2453-4ad9-ad3f-c4ef916f7502 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:56.894580 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d6e571c2-3cb0-4834-8d72-26da857acdac tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:56.894779 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-fd434c52-2453-4ad9-ad3f-c4ef916f7502 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:56.895087 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d6e571c2-3cb0-4834-8d72-26da857acdac tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:56.895538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d6e571c2-3cb0-4834-8d72-26da857acdac tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:56.895973 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d6e571c2-3cb0-4834-8d72-26da857acdac tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:56.896804 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=2 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:56.897781 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=10 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:56.904836 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fd434c52-2453-4ad9-ad3f-c4ef916f7502 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:56.905426 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fd434c52-2453-4ad9-ad3f-c4ef916f7502 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:56.905862 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fd434c52-2453-4ad9-ad3f-c4ef916f7502 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:56.906596 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fd434c52-2453-4ad9-ad3f-c4ef916f7502 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:56.907045 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fd434c52-2453-4ad9-ad3f-c4ef916f7502 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:56.907466 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fd434c52-2453-4ad9-ad3f-c4ef916f7502 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:56.984697 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-fd434c52-2453-4ad9-ad3f-c4ef916f7502 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:56.992253 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-fd434c52-2453-4ad9-ad3f-c4ef916f7502 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1143 microversion: 2.1 time: 0.101825 Aug 17 07:28:56.992826 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 125/253] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:56 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1143 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:57.050191 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d6e571c2-3cb0-4834-8d72-26da857acdac tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:57.058351 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d6e571c2-3cb0-4834-8d72-26da857acdac tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:57.059864 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d6e571c2-3cb0-4834-8d72-26da857acdac tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:57.061050 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d6e571c2-3cb0-4834-8d72-26da857acdac tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.178566 Aug 17 07:28:57.061613 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 129/254] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:28:56 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:28:57.187991 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-2251d265-8d67-4f6d-b315-544503025123 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:57.188603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-2251d265-8d67-4f6d-b315-544503025123 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:57.194411 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2251d265-8d67-4f6d-b315-544503025123 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:57.194909 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2251d265-8d67-4f6d-b315-544503025123 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:57.195344 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2251d265-8d67-4f6d-b315-544503025123 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:57.196025 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2251d265-8d67-4f6d-b315-544503025123 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:57.196476 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2251d265-8d67-4f6d-b315-544503025123 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:57.196898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2251d265-8d67-4f6d-b315-544503025123 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:57.321483 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-2251d265-8d67-4f6d-b315-544503025123 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:57.329456 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-2251d265-8d67-4f6d-b315-544503025123 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1371 microversion: 2.1 time: 0.145965 Aug 17 07:28:57.330026 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 126/255] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:57 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:58.012735 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-f2623369-58c3-4435-9bf3-5b8b1cfe3072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:58.013304 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-f2623369-58c3-4435-9bf3-5b8b1cfe3072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:58.019639 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f2623369-58c3-4435-9bf3-5b8b1cfe3072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:58.020107 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f2623369-58c3-4435-9bf3-5b8b1cfe3072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:58.020530 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f2623369-58c3-4435-9bf3-5b8b1cfe3072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:58.021205 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f2623369-58c3-4435-9bf3-5b8b1cfe3072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:58.021651 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f2623369-58c3-4435-9bf3-5b8b1cfe3072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:58.022094 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f2623369-58c3-4435-9bf3-5b8b1cfe3072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:58.083799 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-f2623369-58c3-4435-9bf3-5b8b1cfe3072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:58.086229 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-714cd6b8-c9ec-4934-84e3-73dec83d0b24 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:58.086833 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-714cd6b8-c9ec-4934-84e3-73dec83d0b24 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:58.092351 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-f2623369-58c3-4435-9bf3-5b8b1cfe3072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1143 microversion: 2.1 time: 0.083016 Aug 17 07:28:58.093218 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 130/256] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:58 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:58.093869 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-714cd6b8-c9ec-4934-84e3-73dec83d0b24 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:58.094356 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-714cd6b8-c9ec-4934-84e3-73dec83d0b24 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:58.094783 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-714cd6b8-c9ec-4934-84e3-73dec83d0b24 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:58.095671 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-714cd6b8-c9ec-4934-84e3-73dec83d0b24 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:58.096117 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-714cd6b8-c9ec-4934-84e3-73dec83d0b24 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:58.098098 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-714cd6b8-c9ec-4934-84e3-73dec83d0b24 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:58.350199 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-4a80cc32-5bb7-4459-acdb-0e6c63a09f56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:58.350818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-4a80cc32-5bb7-4459-acdb-0e6c63a09f56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:58.357160 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4a80cc32-5bb7-4459-acdb-0e6c63a09f56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:58.357849 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4a80cc32-5bb7-4459-acdb-0e6c63a09f56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:58.358318 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4a80cc32-5bb7-4459-acdb-0e6c63a09f56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:58.359047 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4a80cc32-5bb7-4459-acdb-0e6c63a09f56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:58.359500 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4a80cc32-5bb7-4459-acdb-0e6c63a09f56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:58.359929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4a80cc32-5bb7-4459-acdb-0e6c63a09f56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:58.484401 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-714cd6b8-c9ec-4934-84e3-73dec83d0b24 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:58.492512 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-714cd6b8-c9ec-4934-84e3-73dec83d0b24 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:58.494032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-714cd6b8-c9ec-4934-84e3-73dec83d0b24 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:58.495183 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-714cd6b8-c9ec-4934-84e3-73dec83d0b24 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.412877 Aug 17 07:28:58.495730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 127/257] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:28:58 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:28:58.517532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-4a80cc32-5bb7-4459-acdb-0e6c63a09f56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:58.524927 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-4a80cc32-5bb7-4459-acdb-0e6c63a09f56 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1371 microversion: 2.1 time: 0.178713 Aug 17 07:28:58.525569 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 131/258] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:58 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:28:59.113144 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-27e94dc4-a65c-4c25-ae1a-9e47dc3351ce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:59.113654 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-27e94dc4-a65c-4c25-ae1a-9e47dc3351ce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:59.120362 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-27e94dc4-a65c-4c25-ae1a-9e47dc3351ce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:59.120839 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-27e94dc4-a65c-4c25-ae1a-9e47dc3351ce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:59.121266 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-27e94dc4-a65c-4c25-ae1a-9e47dc3351ce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:59.121944 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-27e94dc4-a65c-4c25-ae1a-9e47dc3351ce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:59.122421 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-27e94dc4-a65c-4c25-ae1a-9e47dc3351ce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:59.123426 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-27e94dc4-a65c-4c25-ae1a-9e47dc3351ce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:59.137508 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=100 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:59.182957 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-27e94dc4-a65c-4c25-ae1a-9e47dc3351ce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:59.191045 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-27e94dc4-a65c-4c25-ae1a-9e47dc3351ce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1143 microversion: 2.1 time: 0.081864 Aug 17 07:28:59.191594 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 128/259] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:59 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:28:59.517272 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-72a0ea8a-32d7-43f3-8349-a2e608233a14 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:59.517897 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-72a0ea8a-32d7-43f3-8349-a2e608233a14 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:59.524398 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-72a0ea8a-32d7-43f3-8349-a2e608233a14 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:59.524866 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-72a0ea8a-32d7-43f3-8349-a2e608233a14 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:59.525300 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-72a0ea8a-32d7-43f3-8349-a2e608233a14 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:59.526104 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-72a0ea8a-32d7-43f3-8349-a2e608233a14 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:59.526553 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-72a0ea8a-32d7-43f3-8349-a2e608233a14 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:59.526972 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-72a0ea8a-32d7-43f3-8349-a2e608233a14 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:59.546762 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0368c456-eaae-4d70-a85d-2ee1fb35c3df tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:28:59.547367 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0368c456-eaae-4d70-a85d-2ee1fb35c3df tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:28:59.553198 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0368c456-eaae-4d70-a85d-2ee1fb35c3df tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:59.553645 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0368c456-eaae-4d70-a85d-2ee1fb35c3df tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:59.554110 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0368c456-eaae-4d70-a85d-2ee1fb35c3df tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:59.554787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0368c456-eaae-4d70-a85d-2ee1fb35c3df tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:28:59.555232 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0368c456-eaae-4d70-a85d-2ee1fb35c3df tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:28:59.555657 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0368c456-eaae-4d70-a85d-2ee1fb35c3df tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:28:59.719274 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-72a0ea8a-32d7-43f3-8349-a2e608233a14 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:59.733367 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0368c456-eaae-4d70-a85d-2ee1fb35c3df tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:59.738535 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-72a0ea8a-32d7-43f3-8349-a2e608233a14 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:59.740052 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-72a0ea8a-32d7-43f3-8349-a2e608233a14 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:28:59.740750 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0368c456-eaae-4d70-a85d-2ee1fb35c3df tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1371 microversion: 2.1 time: 0.198623 Aug 17 07:28:59.741203 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-72a0ea8a-32d7-43f3-8349-a2e608233a14 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.227829 Aug 17 07:28:59.741316 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 129/260] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:28:59 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:28:59.741762 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 132/261] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:28:59 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:00.211422 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-863b3a5a-310f-41e1-aa5c-d30ec6edbff7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:00.212024 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-863b3a5a-310f-41e1-aa5c-d30ec6edbff7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:00.218528 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-863b3a5a-310f-41e1-aa5c-d30ec6edbff7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:00.219000 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-863b3a5a-310f-41e1-aa5c-d30ec6edbff7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:00.219435 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-863b3a5a-310f-41e1-aa5c-d30ec6edbff7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:00.220117 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-863b3a5a-310f-41e1-aa5c-d30ec6edbff7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:00.220566 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-863b3a5a-310f-41e1-aa5c-d30ec6edbff7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:00.220984 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-863b3a5a-310f-41e1-aa5c-d30ec6edbff7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:00.282196 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-863b3a5a-310f-41e1-aa5c-d30ec6edbff7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:00.289528 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-863b3a5a-310f-41e1-aa5c-d30ec6edbff7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1143 microversion: 2.1 time: 0.082046 Aug 17 07:29:00.290112 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 130/262] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:00 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:00.762047 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-aa9ea36f-93e0-4005-9544-2e6e23f27ae6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:00.762673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-aa9ea36f-93e0-4005-9544-2e6e23f27ae6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:00.763435 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-619a419a-28f2-488c-85df-1a995bdb9162 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:00.764472 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-619a419a-28f2-488c-85df-1a995bdb9162 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:00.769089 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa9ea36f-93e0-4005-9544-2e6e23f27ae6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:00.769593 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa9ea36f-93e0-4005-9544-2e6e23f27ae6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:00.770025 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa9ea36f-93e0-4005-9544-2e6e23f27ae6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:00.770729 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa9ea36f-93e0-4005-9544-2e6e23f27ae6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:00.770833 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-619a419a-28f2-488c-85df-1a995bdb9162 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:00.771186 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa9ea36f-93e0-4005-9544-2e6e23f27ae6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:00.771378 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-619a419a-28f2-488c-85df-1a995bdb9162 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:00.771618 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa9ea36f-93e0-4005-9544-2e6e23f27ae6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:00.771803 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-619a419a-28f2-488c-85df-1a995bdb9162 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:00.772878 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-619a419a-28f2-488c-85df-1a995bdb9162 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:00.773615 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-619a419a-28f2-488c-85df-1a995bdb9162 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:00.774237 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-619a419a-28f2-488c-85df-1a995bdb9162 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:00.964839 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-aa9ea36f-93e0-4005-9544-2e6e23f27ae6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:00.972051 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-619a419a-28f2-488c-85df-1a995bdb9162 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:00.972769 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-aa9ea36f-93e0-4005-9544-2e6e23f27ae6 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1371 microversion: 2.1 time: 0.216192 Aug 17 07:29:00.973340 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 133/263] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:00 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:00.980259 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-619a419a-28f2-488c-85df-1a995bdb9162 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:00.981779 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-619a419a-28f2-488c-85df-1a995bdb9162 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:00.983565 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-619a419a-28f2-488c-85df-1a995bdb9162 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.224411 Aug 17 07:29:00.984107 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 131/264] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:00 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:29:01.309685 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-5453f97c-6a9a-49c0-9362-b5510c670274 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:01.310382 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-5453f97c-6a9a-49c0-9362-b5510c670274 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:01.316270 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5453f97c-6a9a-49c0-9362-b5510c670274 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:01.316746 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5453f97c-6a9a-49c0-9362-b5510c670274 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:01.317179 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5453f97c-6a9a-49c0-9362-b5510c670274 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:01.317867 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5453f97c-6a9a-49c0-9362-b5510c670274 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:01.318339 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5453f97c-6a9a-49c0-9362-b5510c670274 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:01.318760 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5453f97c-6a9a-49c0-9362-b5510c670274 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:01.380530 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-5453f97c-6a9a-49c0-9362-b5510c670274 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:01.387924 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-5453f97c-6a9a-49c0-9362-b5510c670274 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1143 microversion: 2.1 time: 0.082037 Aug 17 07:29:01.388988 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 134/265] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:01 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:01.994212 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0ceb4a21-260b-4bf0-9e4f-fd568060f5fd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:01.994822 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0ceb4a21-260b-4bf0-9e4f-fd568060f5fd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:02.001519 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0ceb4a21-260b-4bf0-9e4f-fd568060f5fd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:02.002031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0ceb4a21-260b-4bf0-9e4f-fd568060f5fd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:02.002470 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0ceb4a21-260b-4bf0-9e4f-fd568060f5fd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:02.003162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0ceb4a21-260b-4bf0-9e4f-fd568060f5fd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:02.003621 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0ceb4a21-260b-4bf0-9e4f-fd568060f5fd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:02.004040 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0ceb4a21-260b-4bf0-9e4f-fd568060f5fd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:02.006123 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-435eb56c-9cc7-408d-9625-cafc79deca8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:02.006791 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-435eb56c-9cc7-408d-9625-cafc79deca8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:02.012949 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-435eb56c-9cc7-408d-9625-cafc79deca8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:02.013921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-435eb56c-9cc7-408d-9625-cafc79deca8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:02.014373 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-435eb56c-9cc7-408d-9625-cafc79deca8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:02.015057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-435eb56c-9cc7-408d-9625-cafc79deca8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:02.015537 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-435eb56c-9cc7-408d-9625-cafc79deca8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:02.015912 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-435eb56c-9cc7-408d-9625-cafc79deca8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:02.203312 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0ceb4a21-260b-4bf0-9e4f-fd568060f5fd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:02.206166 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-435eb56c-9cc7-408d-9625-cafc79deca8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:02.211138 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0ceb4a21-260b-4bf0-9e4f-fd568060f5fd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1371 microversion: 2.1 time: 0.220999 Aug 17 07:29:02.211811 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 132/266] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:01 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:02.215165 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-435eb56c-9cc7-408d-9625-cafc79deca8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:02.217347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-435eb56c-9cc7-408d-9625-cafc79deca8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:02.218603 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-435eb56c-9cc7-408d-9625-cafc79deca8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.216345 Aug 17 07:29:02.219196 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 135/267] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:02 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:29:02.409234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-308ba67c-8729-4b76-a5d1-4154c25abd0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:02.409845 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-308ba67c-8729-4b76-a5d1-4154c25abd0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:02.415737 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-308ba67c-8729-4b76-a5d1-4154c25abd0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:02.416250 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-308ba67c-8729-4b76-a5d1-4154c25abd0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:02.416686 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-308ba67c-8729-4b76-a5d1-4154c25abd0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:02.417371 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-308ba67c-8729-4b76-a5d1-4154c25abd0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:02.417827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-308ba67c-8729-4b76-a5d1-4154c25abd0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:02.418356 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-308ba67c-8729-4b76-a5d1-4154c25abd0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:02.480564 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-308ba67c-8729-4b76-a5d1-4154c25abd0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:02.487867 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-308ba67c-8729-4b76-a5d1-4154c25abd0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1143 microversion: 2.1 time: 0.082615 Aug 17 07:29:02.488440 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 133/268] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:02 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:03.240349 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c0837732-f2e2-495c-ba08-2f541c2f40ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:03.241076 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c0837732-f2e2-495c-ba08-2f541c2f40ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:03.249287 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b50de77b-bb83-4277-8f66-4a2616d7b91e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:03.250516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-b50de77b-bb83-4277-8f66-4a2616d7b91e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:03.258041 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c0837732-f2e2-495c-ba08-2f541c2f40ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:03.258472 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c0837732-f2e2-495c-ba08-2f541c2f40ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:03.258870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c0837732-f2e2-495c-ba08-2f541c2f40ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:03.259574 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c0837732-f2e2-495c-ba08-2f541c2f40ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:03.260028 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c0837732-f2e2-495c-ba08-2f541c2f40ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:03.260458 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c0837732-f2e2-495c-ba08-2f541c2f40ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:03.266069 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b50de77b-bb83-4277-8f66-4a2616d7b91e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:03.266766 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b50de77b-bb83-4277-8f66-4a2616d7b91e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:03.267204 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b50de77b-bb83-4277-8f66-4a2616d7b91e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:03.267912 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b50de77b-bb83-4277-8f66-4a2616d7b91e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:03.268369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b50de77b-bb83-4277-8f66-4a2616d7b91e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:03.268794 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b50de77b-bb83-4277-8f66-4a2616d7b91e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:03.306839 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=2 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:03.477985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b50de77b-bb83-4277-8f66-4a2616d7b91e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:03.480815 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c0837732-f2e2-495c-ba08-2f541c2f40ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:03.486158 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b50de77b-bb83-4277-8f66-4a2616d7b91e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1371 microversion: 2.1 time: 0.257414 Aug 17 07:29:03.486733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 136/269] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:03 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:03.489520 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c0837732-f2e2-495c-ba08-2f541c2f40ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:03.491054 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c0837732-f2e2-495c-ba08-2f541c2f40ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:03.492459 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c0837732-f2e2-495c-ba08-2f541c2f40ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.255668 Aug 17 07:29:03.493001 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 134/270] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:03 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:29:03.508260 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9a8c7f6f-7ff2-41e8-95ff-9b7976a814ae tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:03.508783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-9a8c7f6f-7ff2-41e8-95ff-9b7976a814ae tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:03.515082 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9a8c7f6f-7ff2-41e8-95ff-9b7976a814ae tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:03.515587 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9a8c7f6f-7ff2-41e8-95ff-9b7976a814ae tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:03.516025 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9a8c7f6f-7ff2-41e8-95ff-9b7976a814ae tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:03.516717 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9a8c7f6f-7ff2-41e8-95ff-9b7976a814ae tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:03.517197 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9a8c7f6f-7ff2-41e8-95ff-9b7976a814ae tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:03.517622 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9a8c7f6f-7ff2-41e8-95ff-9b7976a814ae tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:03.580455 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-9a8c7f6f-7ff2-41e8-95ff-9b7976a814ae tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:03.593830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-9a8c7f6f-7ff2-41e8-95ff-9b7976a814ae tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1191 microversion: 2.1 time: 0.089066 Aug 17 07:29:03.594990 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 137/271] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:03 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:29:03.907683 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b8894ae5-2316-4aea-aa67-56dfa97ed10f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Action: 'create', calling method: .version_select at 0x7f30ac728b80>, body: {"keypair": {"name": "tempest-keypair-1694000622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH2BJizRqoDXnySKPcFF3UGPFayxAn4I3XUIZW0iuYvlxteaEVB+4IvcPwxVu5j4Vi4E16TquHidCevoq4P8pOlZVZfTd6JK5uI9WlpdHPNtAUIn6eYWzmqr3eMW9pFnQ=="}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:03.922903 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-b8894ae5-2316-4aea-aa67-56dfa97ed10f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Getting quotas for project 99d9a3fa9369495ab6d8da88f3d9dbd5. Resources: {'key_pairs'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:29:03.926726 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-b8894ae5-2316-4aea-aa67-56dfa97ed10f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Getting quotas for user f8b0c96c80db4db4a477a1fa6c1fa4db and project 99d9a3fa9369495ab6d8da88f3d9dbd5. Resources: {'key_pairs'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:29:03.957418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b8894ae5-2316-4aea-aa67-56dfa97ed10f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054024 Aug 17 07:29:03.958200 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 135/272] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 17 07:29:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:29:04.507826 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2bdfc5f1-1051-4a7f-ad1e-9c67ee168077 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:04.511171 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-2bdfc5f1-1051-4a7f-ad1e-9c67ee168077 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:04.517287 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-825e782e-d774-4c1d-88db-907e620923bd tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:04.518909 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-825e782e-d774-4c1d-88db-907e620923bd tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:04.520704 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=10 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:04.524391 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2bdfc5f1-1051-4a7f-ad1e-9c67ee168077 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:04.524884 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2bdfc5f1-1051-4a7f-ad1e-9c67ee168077 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:04.525326 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2bdfc5f1-1051-4a7f-ad1e-9c67ee168077 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:04.526064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2bdfc5f1-1051-4a7f-ad1e-9c67ee168077 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:04.526522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2bdfc5f1-1051-4a7f-ad1e-9c67ee168077 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:04.527100 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2bdfc5f1-1051-4a7f-ad1e-9c67ee168077 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:04.531997 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-825e782e-d774-4c1d-88db-907e620923bd tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:04.532661 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-825e782e-d774-4c1d-88db-907e620923bd tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:04.533256 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-825e782e-d774-4c1d-88db-907e620923bd tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:04.534638 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-825e782e-d774-4c1d-88db-907e620923bd tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:04.534638 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-825e782e-d774-4c1d-88db-907e620923bd tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:04.535067 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-825e782e-d774-4c1d-88db-907e620923bd tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:04.847921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2bdfc5f1-1051-4a7f-ad1e-9c67ee168077 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:04.853039 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-825e782e-d774-4c1d-88db-907e620923bd tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:04.855609 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-2bdfc5f1-1051-4a7f-ad1e-9c67ee168077 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1371 microversion: 2.1 time: 0.352148 Aug 17 07:29:04.856618 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 138/273] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:04 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1371 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:04.862129 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a2f96bb8-99ff-4381-9ddb-66d665b02857 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:04.863005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a2f96bb8-99ff-4381-9ddb-66d665b02857 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:04.863846 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-825e782e-d774-4c1d-88db-907e620923bd tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:04.865528 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-825e782e-d774-4c1d-88db-907e620923bd tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:04.867145 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-825e782e-d774-4c1d-88db-907e620923bd tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.356142 Aug 17 07:29:04.869510 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a2f96bb8-99ff-4381-9ddb-66d665b02857 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:04.870240 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a2f96bb8-99ff-4381-9ddb-66d665b02857 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:04.870737 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a2f96bb8-99ff-4381-9ddb-66d665b02857 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:04.871451 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a2f96bb8-99ff-4381-9ddb-66d665b02857 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:04.871926 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a2f96bb8-99ff-4381-9ddb-66d665b02857 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:04.872393 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a2f96bb8-99ff-4381-9ddb-66d665b02857 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:04.878560 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 136/274] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:04 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:04.950620 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a2f96bb8-99ff-4381-9ddb-66d665b02857 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:04.958400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a2f96bb8-99ff-4381-9ddb-66d665b02857 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1209 microversion: 2.1 time: 0.099824 Aug 17 07:29:04.959123 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 139/275] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:04 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1209 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:05.591346 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-cfa27f72-72f4-4fe1-a745-268ae2af01c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1542868190", "imageRef": "37843ca7-b19a-44f1-acf3-e9432324d4b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b93cc108-9c01-472b-9ec8-1ea1c98d8816"}], "security_groups": [{"name": "tempest-securitygroup--412347303"}], "key_name": "tempest-keypair-1694000622", "user_data": "}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:05.691787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.network.neutron [None req-cfa27f72-72f4-4fe1-a745-268ae2af01c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] validate_networks() for [('b93cc108-9c01-472b-9ec8-1ea1c98d8816', None, None, None, None, None)] {{(pid=120834) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:29:05.877224 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2f987ac0-bf3a-4ae5-b168-440e9937363b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:05.877832 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-2f987ac0-bf3a-4ae5-b168-440e9937363b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:05.884308 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2f987ac0-bf3a-4ae5-b168-440e9937363b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:05.884979 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2f987ac0-bf3a-4ae5-b168-440e9937363b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:05.885601 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2f987ac0-bf3a-4ae5-b168-440e9937363b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:05.886501 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2f987ac0-bf3a-4ae5-b168-440e9937363b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:05.886947 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2f987ac0-bf3a-4ae5-b168-440e9937363b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:05.887365 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2f987ac0-bf3a-4ae5-b168-440e9937363b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:06.096911 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2f987ac0-bf3a-4ae5-b168-440e9937363b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:06.104217 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-2f987ac0-bf3a-4ae5-b168-440e9937363b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1371 microversion: 2.1 time: 0.231474 Aug 17 07:29:06.116427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 140/276] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:05 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:29:06.121782 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-bfdf2dad-8460-4a52-a742-61edf5aa1b27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:06.123082 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-bfdf2dad-8460-4a52-a742-61edf5aa1b27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:06.128816 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bfdf2dad-8460-4a52-a742-61edf5aa1b27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:06.129356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bfdf2dad-8460-4a52-a742-61edf5aa1b27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:06.129787 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bfdf2dad-8460-4a52-a742-61edf5aa1b27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:06.130498 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bfdf2dad-8460-4a52-a742-61edf5aa1b27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:06.130943 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bfdf2dad-8460-4a52-a742-61edf5aa1b27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:06.131367 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bfdf2dad-8460-4a52-a742-61edf5aa1b27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:06.135213 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-cfa27f72-72f4-4fe1-a745-268ae2af01c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Flavor limits 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:29:06.135348 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=100 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:06.135641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-cfa27f72-72f4-4fe1-a745-268ae2af01c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Image limits 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:29:06.136278 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-cfa27f72-72f4-4fe1-a745-268ae2af01c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Flavor pref 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:29:06.136701 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-cfa27f72-72f4-4fe1-a745-268ae2af01c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Image pref 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:29:06.137172 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-cfa27f72-72f4-4fe1-a745-268ae2af01c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:29:06.145980 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cfa27f72-72f4-4fe1-a745-268ae2af01c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:06.146458 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cfa27f72-72f4-4fe1-a745-268ae2af01c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:06.146892 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cfa27f72-72f4-4fe1-a745-268ae2af01c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:06.147611 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cfa27f72-72f4-4fe1-a745-268ae2af01c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:06.148060 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cfa27f72-72f4-4fe1-a745-268ae2af01c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:06.148483 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cfa27f72-72f4-4fe1-a745-268ae2af01c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:06.165327 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-cfa27f72-72f4-4fe1-a745-268ae2af01c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Getting quotas for project 99d9a3fa9369495ab6d8da88f3d9dbd5. Resources: {'ram', 'cores', 'instances'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:29:06.169896 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-cfa27f72-72f4-4fe1-a745-268ae2af01c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Getting quotas for user f8b0c96c80db4db4a477a1fa6c1fa4db and project 99d9a3fa9369495ab6d8da88f3d9dbd5. Resources: {'ram', 'cores', 'instances'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:29:06.181020 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-cfa27f72-72f4-4fe1-a745-268ae2af01c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Going to run 1 instances... {{(pid=120834) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:29:06.183330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-cfa27f72-72f4-4fe1-a745-268ae2af01c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37843ca7-b19a-44f1-acf3-e9432324d4b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120834) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:29:06.233132 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-cfa27f72-72f4-4fe1-a745-268ae2af01c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.645971 Aug 17 07:29:06.233880 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 137/277] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:29:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 07:29:06.244121 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f78e3144-670b-49ae-8455-5ac09bba56ee tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:06.244920 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f78e3144-670b-49ae-8455-5ac09bba56ee tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:06.251917 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f78e3144-670b-49ae-8455-5ac09bba56ee tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:06.252531 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f78e3144-670b-49ae-8455-5ac09bba56ee tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:06.253073 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f78e3144-670b-49ae-8455-5ac09bba56ee tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:06.254299 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f78e3144-670b-49ae-8455-5ac09bba56ee tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:06.254640 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f78e3144-670b-49ae-8455-5ac09bba56ee tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:06.255300 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f78e3144-670b-49ae-8455-5ac09bba56ee tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:06.261070 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-bfdf2dad-8460-4a52-a742-61edf5aa1b27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:06.270429 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-bfdf2dad-8460-4a52-a742-61edf5aa1b27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:06.272127 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-bfdf2dad-8460-4a52-a742-61edf5aa1b27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:06.273267 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-bfdf2dad-8460-4a52-a742-61edf5aa1b27 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.155606 Aug 17 07:29:06.274006 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 141/278] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:06 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:06.279812 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9c0fc01a-c3bf-4f80-af11-15890c7fd7ab tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:06.280701 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-9c0fc01a-c3bf-4f80-af11-15890c7fd7ab tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:06.344037 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f78e3144-670b-49ae-8455-5ac09bba56ee tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:06.361690 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f78e3144-670b-49ae-8455-5ac09bba56ee tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1209 microversion: 2.1 time: 0.122559 Aug 17 07:29:06.362314 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 138/279] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:06 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1209 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:06.364053 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-9c0fc01a-c3bf-4f80-af11-15890c7fd7ab tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:06.371382 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-9c0fc01a-c3bf-4f80-af11-15890c7fd7ab tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1242 microversion: 2.1 time: 0.095960 Aug 17 07:29:06.372540 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 142/280] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:06 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:07.124461 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-03a3406c-30d0-42e8-9da6-cc2a9398ec03 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:07.125093 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-03a3406c-30d0-42e8-9da6-cc2a9398ec03 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:07.131448 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-03a3406c-30d0-42e8-9da6-cc2a9398ec03 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:07.131929 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-03a3406c-30d0-42e8-9da6-cc2a9398ec03 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:07.132403 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-03a3406c-30d0-42e8-9da6-cc2a9398ec03 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:07.133094 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-03a3406c-30d0-42e8-9da6-cc2a9398ec03 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:07.133548 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-03a3406c-30d0-42e8-9da6-cc2a9398ec03 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:07.133990 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-03a3406c-30d0-42e8-9da6-cc2a9398ec03 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:07.262125 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-03a3406c-30d0-42e8-9da6-cc2a9398ec03 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:07.269987 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-03a3406c-30d0-42e8-9da6-cc2a9398ec03 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1371 microversion: 2.1 time: 0.149367 Aug 17 07:29:07.270565 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 139/281] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:07 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:07.296710 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-95d702ff-740f-4770-abd2-251c0f989aea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:07.297375 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-95d702ff-740f-4770-abd2-251c0f989aea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:07.303780 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-95d702ff-740f-4770-abd2-251c0f989aea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:07.304257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-95d702ff-740f-4770-abd2-251c0f989aea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:07.304734 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-95d702ff-740f-4770-abd2-251c0f989aea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:07.305453 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-95d702ff-740f-4770-abd2-251c0f989aea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:07.305902 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-95d702ff-740f-4770-abd2-251c0f989aea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:07.306350 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-95d702ff-740f-4770-abd2-251c0f989aea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:07.386725 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-79c701ef-0e74-414c-b8a1-80a0f16d76bc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:07.387878 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-79c701ef-0e74-414c-b8a1-80a0f16d76bc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:07.397101 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-79c701ef-0e74-414c-b8a1-80a0f16d76bc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:07.398643 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-79c701ef-0e74-414c-b8a1-80a0f16d76bc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:07.399303 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-79c701ef-0e74-414c-b8a1-80a0f16d76bc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:07.400273 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-79c701ef-0e74-414c-b8a1-80a0f16d76bc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:07.401105 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-79c701ef-0e74-414c-b8a1-80a0f16d76bc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:07.401814 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-79c701ef-0e74-414c-b8a1-80a0f16d76bc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:07.485369 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-79c701ef-0e74-414c-b8a1-80a0f16d76bc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:07.493778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-79c701ef-0e74-414c-b8a1-80a0f16d76bc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1209 microversion: 2.1 time: 0.114063 Aug 17 07:29:07.494606 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 140/282] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:07 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1209 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:07.500103 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-33744b2b-ad7b-4ec4-aa7d-8f4ef04f07cf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:07.500980 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-33744b2b-ad7b-4ec4-aa7d-8f4ef04f07cf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:07.507840 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-33744b2b-ad7b-4ec4-aa7d-8f4ef04f07cf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:07.508483 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-33744b2b-ad7b-4ec4-aa7d-8f4ef04f07cf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:07.509156 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-33744b2b-ad7b-4ec4-aa7d-8f4ef04f07cf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:07.509767 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-33744b2b-ad7b-4ec4-aa7d-8f4ef04f07cf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:07.510321 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-33744b2b-ad7b-4ec4-aa7d-8f4ef04f07cf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:07.510904 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-33744b2b-ad7b-4ec4-aa7d-8f4ef04f07cf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:07.621549 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-33744b2b-ad7b-4ec4-aa7d-8f4ef04f07cf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:07.635467 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-33744b2b-ad7b-4ec4-aa7d-8f4ef04f07cf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1238 microversion: 2.1 time: 0.137819 Aug 17 07:29:07.636719 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 141/283] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:07 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1238 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:07.650027 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-95d702ff-740f-4770-abd2-251c0f989aea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:07.658525 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-95d702ff-740f-4770-abd2-251c0f989aea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:07.660259 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-95d702ff-740f-4770-abd2-251c0f989aea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:07.661459 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-95d702ff-740f-4770-abd2-251c0f989aea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.368887 Aug 17 07:29:07.666535 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 143/284] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:07 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:08.290723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b171cb33-55ad-42ab-8571-b5b44e2155ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:08.292645 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-b171cb33-55ad-42ab-8571-b5b44e2155ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:08.303377 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b171cb33-55ad-42ab-8571-b5b44e2155ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:08.303861 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b171cb33-55ad-42ab-8571-b5b44e2155ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:08.304299 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b171cb33-55ad-42ab-8571-b5b44e2155ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:08.305004 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b171cb33-55ad-42ab-8571-b5b44e2155ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:08.305457 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b171cb33-55ad-42ab-8571-b5b44e2155ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:08.305880 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b171cb33-55ad-42ab-8571-b5b44e2155ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:08.487905 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-b171cb33-55ad-42ab-8571-b5b44e2155ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:08.497112 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b171cb33-55ad-42ab-8571-b5b44e2155ce tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1566 microversion: 2.1 time: 0.210059 Aug 17 07:29:08.507455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 142/285] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:08 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1566 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:08.516711 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a038b739-6cb6-4611-9d4d-2fd5efd545c8 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:08.517464 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a038b739-6cb6-4611-9d4d-2fd5efd545c8 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:08.521427 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-46088029-b36c-4c92-aa49-11cfe155a36e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:08.521427 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-46088029-b36c-4c92-aa49-11cfe155a36e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:08.525877 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a038b739-6cb6-4611-9d4d-2fd5efd545c8 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:08.526461 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a038b739-6cb6-4611-9d4d-2fd5efd545c8 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:08.526899 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a038b739-6cb6-4611-9d4d-2fd5efd545c8 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:08.527577 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a038b739-6cb6-4611-9d4d-2fd5efd545c8 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:08.528073 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a038b739-6cb6-4611-9d4d-2fd5efd545c8 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:08.528581 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a038b739-6cb6-4611-9d4d-2fd5efd545c8 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:08.542258 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-46088029-b36c-4c92-aa49-11cfe155a36e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:08.543346 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-46088029-b36c-4c92-aa49-11cfe155a36e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:08.543996 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-46088029-b36c-4c92-aa49-11cfe155a36e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:08.545849 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-46088029-b36c-4c92-aa49-11cfe155a36e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:08.546348 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-46088029-b36c-4c92-aa49-11cfe155a36e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:08.546990 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-46088029-b36c-4c92-aa49-11cfe155a36e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:08.700028 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-46088029-b36c-4c92-aa49-11cfe155a36e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.183765 Aug 17 07:29:08.700799 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 143/286] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 17 07:29:08 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/os-interface => generated 285 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:29:08.706768 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-62eb9bd9-408f-47b1-9687-24143c67a611 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:08.707697 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-62eb9bd9-408f-47b1-9687-24143c67a611 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:08.720288 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-62eb9bd9-408f-47b1-9687-24143c67a611 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:08.720801 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-62eb9bd9-408f-47b1-9687-24143c67a611 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:08.722571 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-62eb9bd9-408f-47b1-9687-24143c67a611 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:08.723196 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-62eb9bd9-408f-47b1-9687-24143c67a611 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:08.724546 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-62eb9bd9-408f-47b1-9687-24143c67a611 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:08.724988 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-62eb9bd9-408f-47b1-9687-24143c67a611 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:08.846770 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-62eb9bd9-408f-47b1-9687-24143c67a611 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:08.859978 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-62eb9bd9-408f-47b1-9687-24143c67a611 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1294 microversion: 2.1 time: 0.157791 Aug 17 07:29:08.862052 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 144/287] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:08 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1294 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:08.880763 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9bbd9c90-6ea0-45dc-bb9b-fff34a82911b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:08.881683 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9bbd9c90-6ea0-45dc-bb9b-fff34a82911b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:08.896165 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9bbd9c90-6ea0-45dc-bb9b-fff34a82911b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:08.901985 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9bbd9c90-6ea0-45dc-bb9b-fff34a82911b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:08.902766 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9bbd9c90-6ea0-45dc-bb9b-fff34a82911b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:08.905049 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9bbd9c90-6ea0-45dc-bb9b-fff34a82911b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:08.905695 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9bbd9c90-6ea0-45dc-bb9b-fff34a82911b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:08.909227 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9bbd9c90-6ea0-45dc-bb9b-fff34a82911b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:09.008677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a038b739-6cb6-4611-9d4d-2fd5efd545c8 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:09.026811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a038b739-6cb6-4611-9d4d-2fd5efd545c8 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1276 microversion: 2.1 time: 0.514509 Aug 17 07:29:09.027482 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 144/288] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:08 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1276 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:29:09.283478 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-9bbd9c90-6ea0-45dc-bb9b-fff34a82911b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:09.294313 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-9bbd9c90-6ea0-45dc-bb9b-fff34a82911b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:09.300031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-9bbd9c90-6ea0-45dc-bb9b-fff34a82911b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:09.303573 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9bbd9c90-6ea0-45dc-bb9b-fff34a82911b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1743 microversion: 2.20 time: 0.435597 Aug 17 07:29:09.305167 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 145/289] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:08 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1743 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:09.890698 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-cefd5567-4616-43a0-a2a8-16a14dfa8a60 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:09.892004 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-cefd5567-4616-43a0-a2a8-16a14dfa8a60 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:09.898648 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-cefd5567-4616-43a0-a2a8-16a14dfa8a60 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:09.904943 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-cefd5567-4616-43a0-a2a8-16a14dfa8a60 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:09.905716 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-cefd5567-4616-43a0-a2a8-16a14dfa8a60 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:09.907125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-cefd5567-4616-43a0-a2a8-16a14dfa8a60 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:09.909011 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-cefd5567-4616-43a0-a2a8-16a14dfa8a60 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:09.909710 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-cefd5567-4616-43a0-a2a8-16a14dfa8a60 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:10.052845 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a6f3d2cb-3bc6-4db4-8d4d-0ccc135404eb tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:10.053467 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-a6f3d2cb-3bc6-4db4-8d4d-0ccc135404eb tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:10.061864 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a6f3d2cb-3bc6-4db4-8d4d-0ccc135404eb tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:10.062665 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a6f3d2cb-3bc6-4db4-8d4d-0ccc135404eb tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:10.063252 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a6f3d2cb-3bc6-4db4-8d4d-0ccc135404eb tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:10.064185 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a6f3d2cb-3bc6-4db4-8d4d-0ccc135404eb tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:10.064721 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a6f3d2cb-3bc6-4db4-8d4d-0ccc135404eb tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:10.065295 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a6f3d2cb-3bc6-4db4-8d4d-0ccc135404eb tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:10.198057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-cefd5567-4616-43a0-a2a8-16a14dfa8a60 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:10.262414 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-cefd5567-4616-43a0-a2a8-16a14dfa8a60 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1300 microversion: 2.1 time: 0.373455 Aug 17 07:29:10.265500 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 145/290] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:09 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1300 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:10.278223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-33a4864e-df72-4d24-8d30-6f58b6a2c587 req-84c6591f-28a1-4b0b-862f-cb0129c6b5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da23597a-1e52-4e8a-bd7b-28bd175471ae", "tag": "38d23e53-70d4-4b98-ae25-a473ae03bd51"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:10.301302 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-33a4864e-df72-4d24-8d30-6f58b6a2c587 req-84c6591f-28a1-4b0b-862f-cb0129c6b5f8 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:10.302077 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-33a4864e-df72-4d24-8d30-6f58b6a2c587 req-84c6591f-28a1-4b0b-862f-cb0129c6b5f8 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:10.302900 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-33a4864e-df72-4d24-8d30-6f58b6a2c587 req-84c6591f-28a1-4b0b-862f-cb0129c6b5f8 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:10.320534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-33a4864e-df72-4d24-8d30-6f58b6a2c587 req-84c6591f-28a1-4b0b-862f-cb0129c6b5f8 service nova] Creating event network-changed:38d23e53-70d4-4b98-ae25-a473ae03bd51 for instance da23597a-1e52-4e8a-bd7b-28bd175471ae on hv-cinder-85312 Aug 17 07:29:10.333840 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-33a4864e-df72-4d24-8d30-6f58b6a2c587 req-84c6591f-28a1-4b0b-862f-cb0129c6b5f8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065220 Aug 17 07:29:10.335228 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 146/291] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:29:10.347600 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-87cbb5bd-f5a0-47f0-a933-ed219235649f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:10.351121 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-87cbb5bd-f5a0-47f0-a933-ed219235649f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:10.362845 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87cbb5bd-f5a0-47f0-a933-ed219235649f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:10.363650 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87cbb5bd-f5a0-47f0-a933-ed219235649f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:10.364372 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87cbb5bd-f5a0-47f0-a933-ed219235649f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:10.365645 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87cbb5bd-f5a0-47f0-a933-ed219235649f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:10.368202 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87cbb5bd-f5a0-47f0-a933-ed219235649f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:10.368859 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87cbb5bd-f5a0-47f0-a933-ed219235649f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:10.389685 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a6f3d2cb-3bc6-4db4-8d4d-0ccc135404eb tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:10.407215 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a6f3d2cb-3bc6-4db4-8d4d-0ccc135404eb tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1276 microversion: 2.1 time: 0.355809 Aug 17 07:29:10.410082 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 146/292] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:10 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1276 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:29:10.692453 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-87cbb5bd-f5a0-47f0-a933-ed219235649f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:10.712437 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-87cbb5bd-f5a0-47f0-a933-ed219235649f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:10.716869 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-87cbb5bd-f5a0-47f0-a933-ed219235649f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:10.720806 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-87cbb5bd-f5a0-47f0-a933-ed219235649f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1743 microversion: 2.20 time: 0.382181 Aug 17 07:29:10.765948 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 147/293] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:10 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1743 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:10.846244 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-ff55a65e-bb1a-44a0-8dad-2cfb98c97a20 req-61f16aed-eccc-4b52-a15b-3bc9f4b23753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f58c6a6-fa9c-4795-97c2-525c1510124b", "tag": "0799a736-86ba-40d5-8200-f99f2281e899"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:10.871484 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-ff55a65e-bb1a-44a0-8dad-2cfb98c97a20 req-61f16aed-eccc-4b52-a15b-3bc9f4b23753 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:10.872039 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-ff55a65e-bb1a-44a0-8dad-2cfb98c97a20 req-61f16aed-eccc-4b52-a15b-3bc9f4b23753 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:10.875463 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-ff55a65e-bb1a-44a0-8dad-2cfb98c97a20 req-61f16aed-eccc-4b52-a15b-3bc9f4b23753 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:10.887124 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=100 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:10.899894 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-ff55a65e-bb1a-44a0-8dad-2cfb98c97a20 req-61f16aed-eccc-4b52-a15b-3bc9f4b23753 service nova] Creating event network-changed:0799a736-86ba-40d5-8200-f99f2281e899 for instance 1f58c6a6-fa9c-4795-97c2-525c1510124b on hv-cinder-85312 Aug 17 07:29:10.908198 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-ff55a65e-bb1a-44a0-8dad-2cfb98c97a20 req-61f16aed-eccc-4b52-a15b-3bc9f4b23753 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069393 Aug 17 07:29:10.909726 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 147/294] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:29:11.285059 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-943ec5dd-f5d4-4393-92c5-f85d53f26d8a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:11.285795 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-943ec5dd-f5d4-4393-92c5-f85d53f26d8a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:11.298396 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-943ec5dd-f5d4-4393-92c5-f85d53f26d8a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:11.299232 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-943ec5dd-f5d4-4393-92c5-f85d53f26d8a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:11.300853 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-943ec5dd-f5d4-4393-92c5-f85d53f26d8a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:11.303945 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-943ec5dd-f5d4-4393-92c5-f85d53f26d8a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:11.304673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-943ec5dd-f5d4-4393-92c5-f85d53f26d8a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:11.305418 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-943ec5dd-f5d4-4393-92c5-f85d53f26d8a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:11.433051 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-fa2232bd-7b31-4086-9ca7-2cff88f5d5dc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:11.439153 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-fa2232bd-7b31-4086-9ca7-2cff88f5d5dc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:11.461110 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fa2232bd-7b31-4086-9ca7-2cff88f5d5dc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:11.465213 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fa2232bd-7b31-4086-9ca7-2cff88f5d5dc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:11.465759 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fa2232bd-7b31-4086-9ca7-2cff88f5d5dc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:11.477178 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fa2232bd-7b31-4086-9ca7-2cff88f5d5dc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:11.479341 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fa2232bd-7b31-4086-9ca7-2cff88f5d5dc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:11.481039 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fa2232bd-7b31-4086-9ca7-2cff88f5d5dc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:11.685527 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-943ec5dd-f5d4-4393-92c5-f85d53f26d8a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:11.696370 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-943ec5dd-f5d4-4393-92c5-f85d53f26d8a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1367 microversion: 2.1 time: 0.415391 Aug 17 07:29:11.696943 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 148/295] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:11 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1367 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:11.717204 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-0e05ab35-52bb-48cf-83d6-4d3bf3ba2089 req-f97f0e6e-1ed2-4aa8-ac35-ff247e20298d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebfec5b-68c1-41cd-910b-e73220fc2fd6", "name": "network-vif-plugged", "status": "completed", "tag": "dc7af87b-fe16-4334-a953-7e5e2d03e8e7"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:11.762046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-0e05ab35-52bb-48cf-83d6-4d3bf3ba2089 req-f97f0e6e-1ed2-4aa8-ac35-ff247e20298d service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:11.762549 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-0e05ab35-52bb-48cf-83d6-4d3bf3ba2089 req-f97f0e6e-1ed2-4aa8-ac35-ff247e20298d service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:11.762985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-0e05ab35-52bb-48cf-83d6-4d3bf3ba2089 req-f97f0e6e-1ed2-4aa8-ac35-ff247e20298d service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:11.807549 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-0e05ab35-52bb-48cf-83d6-4d3bf3ba2089 req-f97f0e6e-1ed2-4aa8-ac35-ff247e20298d service nova] Creating event network-vif-plugged:dc7af87b-fe16-4334-a953-7e5e2d03e8e7 for instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 on hv-cinder-85312 Aug 17 07:29:11.819251 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-0e05ab35-52bb-48cf-83d6-4d3bf3ba2089 req-f97f0e6e-1ed2-4aa8-ac35-ff247e20298d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118144 Aug 17 07:29:11.825106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 149/296] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:29:11.840019 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-855b97d2-24b7-4eaf-9065-0f870a7b0f63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:11.841509 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-855b97d2-24b7-4eaf-9065-0f870a7b0f63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:11.860475 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-855b97d2-24b7-4eaf-9065-0f870a7b0f63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:11.865676 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-855b97d2-24b7-4eaf-9065-0f870a7b0f63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:11.867436 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-855b97d2-24b7-4eaf-9065-0f870a7b0f63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:11.869872 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-855b97d2-24b7-4eaf-9065-0f870a7b0f63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:11.872171 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-855b97d2-24b7-4eaf-9065-0f870a7b0f63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:11.873523 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-855b97d2-24b7-4eaf-9065-0f870a7b0f63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:11.880986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-fa2232bd-7b31-4086-9ca7-2cff88f5d5dc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:11.934475 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-fa2232bd-7b31-4086-9ca7-2cff88f5d5dc tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1276 microversion: 2.1 time: 0.506004 Aug 17 07:29:11.942813 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 148/297] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:11 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1276 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:12.078583 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-855b97d2-24b7-4eaf-9065-0f870a7b0f63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:12.091940 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-855b97d2-24b7-4eaf-9065-0f870a7b0f63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:12.095064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-855b97d2-24b7-4eaf-9065-0f870a7b0f63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:12.096764 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-855b97d2-24b7-4eaf-9065-0f870a7b0f63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1738 microversion: 2.20 time: 0.270150 Aug 17 07:29:12.098276 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 150/298] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:11 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1738 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:12.725172 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c923af69-7129-4471-91b0-7e5550d1560d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:12.729470 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c923af69-7129-4471-91b0-7e5550d1560d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:12.738871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c923af69-7129-4471-91b0-7e5550d1560d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:12.739424 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c923af69-7129-4471-91b0-7e5550d1560d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:12.739917 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c923af69-7129-4471-91b0-7e5550d1560d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:12.740636 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c923af69-7129-4471-91b0-7e5550d1560d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:12.741095 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c923af69-7129-4471-91b0-7e5550d1560d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:12.741702 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c923af69-7129-4471-91b0-7e5550d1560d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:12.947668 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c923af69-7129-4471-91b0-7e5550d1560d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:12.959188 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c923af69-7129-4471-91b0-7e5550d1560d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1367 microversion: 2.1 time: 0.245678 Aug 17 07:29:12.962412 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b280f897-3463-41c0-b7c7-f4d39a625de6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:12.964085 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-b280f897-3463-41c0-b7c7-f4d39a625de6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:12.975133 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 149/299] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:12 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:12.977657 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b280f897-3463-41c0-b7c7-f4d39a625de6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:12.978279 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b280f897-3463-41c0-b7c7-f4d39a625de6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:12.978943 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b280f897-3463-41c0-b7c7-f4d39a625de6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:12.979749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b280f897-3463-41c0-b7c7-f4d39a625de6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:12.980302 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b280f897-3463-41c0-b7c7-f4d39a625de6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:12.981097 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b280f897-3463-41c0-b7c7-f4d39a625de6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:13.121879 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-28104fbb-a404-41df-bb5c-ca0fe7599234 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:13.126072 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-28104fbb-a404-41df-bb5c-ca0fe7599234 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:13.152157 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-28104fbb-a404-41df-bb5c-ca0fe7599234 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:13.162576 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-28104fbb-a404-41df-bb5c-ca0fe7599234 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:13.163199 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-28104fbb-a404-41df-bb5c-ca0fe7599234 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:13.164718 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-28104fbb-a404-41df-bb5c-ca0fe7599234 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:13.165383 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-28104fbb-a404-41df-bb5c-ca0fe7599234 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:13.165817 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-28104fbb-a404-41df-bb5c-ca0fe7599234 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:13.246660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b280f897-3463-41c0-b7c7-f4d39a625de6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:13.255631 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b280f897-3463-41c0-b7c7-f4d39a625de6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1276 microversion: 2.1 time: 0.298760 Aug 17 07:29:13.258591 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 151/300] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:12 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1276 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:29:13.501093 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-28104fbb-a404-41df-bb5c-ca0fe7599234 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:13.514096 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-28104fbb-a404-41df-bb5c-ca0fe7599234 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:13.517174 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-28104fbb-a404-41df-bb5c-ca0fe7599234 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:13.520598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-28104fbb-a404-41df-bb5c-ca0fe7599234 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1738 microversion: 2.20 time: 0.402823 Aug 17 07:29:13.533108 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 150/301] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:13 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1738 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:13.880843 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-4b571c42-9188-49d9-8c39-3123705da2c5 req-c4db8722-28fb-4d5f-8cc8-e65a61713d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe690bb-f5a6-4080-aad0-4e79bf213d27", "tag": "dbfd8859-14f2-4d83-923c-5789febe3ba4"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:13.902039 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-4b571c42-9188-49d9-8c39-3123705da2c5 req-c4db8722-28fb-4d5f-8cc8-e65a61713d75 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:13.906477 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-4b571c42-9188-49d9-8c39-3123705da2c5 req-c4db8722-28fb-4d5f-8cc8-e65a61713d75 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:13.909347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-4b571c42-9188-49d9-8c39-3123705da2c5 req-c4db8722-28fb-4d5f-8cc8-e65a61713d75 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:13.952263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-4b571c42-9188-49d9-8c39-3123705da2c5 req-c4db8722-28fb-4d5f-8cc8-e65a61713d75 service nova] Creating event network-changed:dbfd8859-14f2-4d83-923c-5789febe3ba4 for instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 on hv-cinder-85312 Aug 17 07:29:13.963948 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-4b571c42-9188-49d9-8c39-3123705da2c5 req-c4db8722-28fb-4d5f-8cc8-e65a61713d75 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088123 Aug 17 07:29:13.967271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 152/302] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:29:13.979501 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-81e0e6dc-2170-4e0b-96e8-54267f8f98fd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:13.981008 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-81e0e6dc-2170-4e0b-96e8-54267f8f98fd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:13.991799 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-81e0e6dc-2170-4e0b-96e8-54267f8f98fd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:13.992898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-81e0e6dc-2170-4e0b-96e8-54267f8f98fd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:13.993532 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-81e0e6dc-2170-4e0b-96e8-54267f8f98fd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:13.994485 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-81e0e6dc-2170-4e0b-96e8-54267f8f98fd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:13.999627 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-81e0e6dc-2170-4e0b-96e8-54267f8f98fd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:14.000473 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-81e0e6dc-2170-4e0b-96e8-54267f8f98fd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:14.255268 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-81e0e6dc-2170-4e0b-96e8-54267f8f98fd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:14.263735 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-81e0e6dc-2170-4e0b-96e8-54267f8f98fd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1367 microversion: 2.1 time: 0.287925 Aug 17 07:29:14.267976 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 151/303] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:13 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:14.286112 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-265bd8f7-fc86-4161-9e67-018093be6ab9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:14.287405 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-265bd8f7-fc86-4161-9e67-018093be6ab9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:14.296150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-265bd8f7-fc86-4161-9e67-018093be6ab9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:14.296840 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-265bd8f7-fc86-4161-9e67-018093be6ab9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:14.297519 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-265bd8f7-fc86-4161-9e67-018093be6ab9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:14.298352 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-265bd8f7-fc86-4161-9e67-018093be6ab9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:14.299270 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-265bd8f7-fc86-4161-9e67-018093be6ab9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:14.299916 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-265bd8f7-fc86-4161-9e67-018093be6ab9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:14.485672 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-265bd8f7-fc86-4161-9e67-018093be6ab9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:14.493755 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-265bd8f7-fc86-4161-9e67-018093be6ab9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1276 microversion: 2.1 time: 0.212071 Aug 17 07:29:14.508837 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 153/304] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:14 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1276 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:14.545658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f0bdd10b-0c08-41cd-aefd-e27ccbbb34ee tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:14.546464 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f0bdd10b-0c08-41cd-aefd-e27ccbbb34ee tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:14.553401 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f0bdd10b-0c08-41cd-aefd-e27ccbbb34ee tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:14.554310 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f0bdd10b-0c08-41cd-aefd-e27ccbbb34ee tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:14.555031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f0bdd10b-0c08-41cd-aefd-e27ccbbb34ee tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:14.556240 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f0bdd10b-0c08-41cd-aefd-e27ccbbb34ee tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:14.556857 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f0bdd10b-0c08-41cd-aefd-e27ccbbb34ee tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:14.557443 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f0bdd10b-0c08-41cd-aefd-e27ccbbb34ee tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:14.950908 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f0bdd10b-0c08-41cd-aefd-e27ccbbb34ee tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:14.964414 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f0bdd10b-0c08-41cd-aefd-e27ccbbb34ee tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:14.966219 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f0bdd10b-0c08-41cd-aefd-e27ccbbb34ee tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:14.967613 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f0bdd10b-0c08-41cd-aefd-e27ccbbb34ee tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1738 microversion: 2.20 time: 0.426230 Aug 17 07:29:14.968702 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 152/305] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:14 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1738 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:29:15.287227 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-480c4e7e-6766-45a0-8985-c2d0c3c71bd5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:15.288615 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-480c4e7e-6766-45a0-8985-c2d0c3c71bd5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:15.299738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-480c4e7e-6766-45a0-8985-c2d0c3c71bd5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:15.302359 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-480c4e7e-6766-45a0-8985-c2d0c3c71bd5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:15.303021 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-480c4e7e-6766-45a0-8985-c2d0c3c71bd5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:15.304984 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-480c4e7e-6766-45a0-8985-c2d0c3c71bd5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:15.305619 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-480c4e7e-6766-45a0-8985-c2d0c3c71bd5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:15.308822 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-480c4e7e-6766-45a0-8985-c2d0c3c71bd5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:15.516445 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a4da8241-dd93-44a7-ac11-d26a68b4b3a1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:15.517068 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-a4da8241-dd93-44a7-ac11-d26a68b4b3a1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:15.529304 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a4da8241-dd93-44a7-ac11-d26a68b4b3a1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:15.531418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a4da8241-dd93-44a7-ac11-d26a68b4b3a1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:15.532065 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a4da8241-dd93-44a7-ac11-d26a68b4b3a1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:15.533795 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a4da8241-dd93-44a7-ac11-d26a68b4b3a1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:15.535091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a4da8241-dd93-44a7-ac11-d26a68b4b3a1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:15.537074 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a4da8241-dd93-44a7-ac11-d26a68b4b3a1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:15.588221 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-480c4e7e-6766-45a0-8985-c2d0c3c71bd5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:15.602332 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-480c4e7e-6766-45a0-8985-c2d0c3c71bd5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1367 microversion: 2.1 time: 0.314269 Aug 17 07:29:15.606224 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 154/306] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:15 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:15.859000 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a4da8241-dd93-44a7-ac11-d26a68b4b3a1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:15.873591 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a4da8241-dd93-44a7-ac11-d26a68b4b3a1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1276 microversion: 2.1 time: 0.361077 Aug 17 07:29:15.892574 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 153/307] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:15 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1276 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:15.995665 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9cb35671-7115-4306-9dc4-608f008e2488 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:15.996784 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-9cb35671-7115-4306-9dc4-608f008e2488 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:16.008051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9cb35671-7115-4306-9dc4-608f008e2488 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:16.008795 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9cb35671-7115-4306-9dc4-608f008e2488 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:16.009397 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9cb35671-7115-4306-9dc4-608f008e2488 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:16.014882 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9cb35671-7115-4306-9dc4-608f008e2488 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:16.022044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9cb35671-7115-4306-9dc4-608f008e2488 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:16.022764 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9cb35671-7115-4306-9dc4-608f008e2488 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:16.332009 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-9cb35671-7115-4306-9dc4-608f008e2488 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:16.365200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-9cb35671-7115-4306-9dc4-608f008e2488 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:16.380610 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-9cb35671-7115-4306-9dc4-608f008e2488 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:16.382673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-9cb35671-7115-4306-9dc4-608f008e2488 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1738 microversion: 2.20 time: 0.392226 Aug 17 07:29:16.383976 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 155/308] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:15 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1738 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:16.624690 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0b422dcc-a481-497a-8d40-1caf8361b3b8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:16.625197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0b422dcc-a481-497a-8d40-1caf8361b3b8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:16.627376 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=2 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:16.627964 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=10 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:16.634287 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0b422dcc-a481-497a-8d40-1caf8361b3b8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:16.634954 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0b422dcc-a481-497a-8d40-1caf8361b3b8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:16.635813 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0b422dcc-a481-497a-8d40-1caf8361b3b8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:16.636677 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0b422dcc-a481-497a-8d40-1caf8361b3b8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:16.637392 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0b422dcc-a481-497a-8d40-1caf8361b3b8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:16.638046 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0b422dcc-a481-497a-8d40-1caf8361b3b8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:16.845507 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0b422dcc-a481-497a-8d40-1caf8361b3b8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:16.855800 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0b422dcc-a481-497a-8d40-1caf8361b3b8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1367 microversion: 2.1 time: 0.235619 Aug 17 07:29:16.856382 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 154/309] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:16 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:16.902923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a38aa35e-954e-4337-8d03-7181e341a5ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:16.903834 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a38aa35e-954e-4337-8d03-7181e341a5ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:16.914486 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=2 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:16.919309 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a38aa35e-954e-4337-8d03-7181e341a5ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:16.922724 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a38aa35e-954e-4337-8d03-7181e341a5ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:16.923500 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a38aa35e-954e-4337-8d03-7181e341a5ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:16.925170 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a38aa35e-954e-4337-8d03-7181e341a5ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:16.926472 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a38aa35e-954e-4337-8d03-7181e341a5ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:16.929686 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a38aa35e-954e-4337-8d03-7181e341a5ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:17.180986 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a38aa35e-954e-4337-8d03-7181e341a5ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:17.204598 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a38aa35e-954e-4337-8d03-7181e341a5ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1276 microversion: 2.1 time: 0.306947 Aug 17 07:29:17.205259 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 156/310] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:16 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1276 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:17.417305 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-bc57709c-9658-41d1-ab6c-e0356f127b39 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:17.417911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-bc57709c-9658-41d1-ab6c-e0356f127b39 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:17.437861 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bc57709c-9658-41d1-ab6c-e0356f127b39 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:17.438382 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bc57709c-9658-41d1-ab6c-e0356f127b39 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:17.438826 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bc57709c-9658-41d1-ab6c-e0356f127b39 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:17.439699 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bc57709c-9658-41d1-ab6c-e0356f127b39 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:17.440154 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bc57709c-9658-41d1-ab6c-e0356f127b39 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:17.440773 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bc57709c-9658-41d1-ab6c-e0356f127b39 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:17.798433 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-bc57709c-9658-41d1-ab6c-e0356f127b39 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:17.817630 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-bc57709c-9658-41d1-ab6c-e0356f127b39 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:17.824295 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-bc57709c-9658-41d1-ab6c-e0356f127b39 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:17.826030 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-bc57709c-9658-41d1-ab6c-e0356f127b39 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1738 microversion: 2.20 time: 0.413589 Aug 17 07:29:17.834647 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 155/311] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:17 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1738 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:17.882691 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-6d25cf66-8fcc-4fc4-97f3-e602a50d7ddc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:17.884164 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-6d25cf66-8fcc-4fc4-97f3-e602a50d7ddc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:17.892964 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6d25cf66-8fcc-4fc4-97f3-e602a50d7ddc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:17.893839 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6d25cf66-8fcc-4fc4-97f3-e602a50d7ddc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:17.894528 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6d25cf66-8fcc-4fc4-97f3-e602a50d7ddc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:17.895551 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6d25cf66-8fcc-4fc4-97f3-e602a50d7ddc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:17.896353 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6d25cf66-8fcc-4fc4-97f3-e602a50d7ddc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:17.897993 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6d25cf66-8fcc-4fc4-97f3-e602a50d7ddc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:18.170792 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-6d25cf66-8fcc-4fc4-97f3-e602a50d7ddc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:18.191758 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-6d25cf66-8fcc-4fc4-97f3-e602a50d7ddc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1367 microversion: 2.1 time: 0.313717 Aug 17 07:29:18.202442 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 157/312] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:17 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:18.236569 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c94a029b-a51f-497f-a81e-205a96e45bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:18.237480 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c94a029b-a51f-497f-a81e-205a96e45bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:18.259994 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c94a029b-a51f-497f-a81e-205a96e45bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:18.262471 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c94a029b-a51f-497f-a81e-205a96e45bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:18.264469 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c94a029b-a51f-497f-a81e-205a96e45bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:18.265669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c94a029b-a51f-497f-a81e-205a96e45bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:18.269231 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c94a029b-a51f-497f-a81e-205a96e45bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:18.269919 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c94a029b-a51f-497f-a81e-205a96e45bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:18.531245 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c94a029b-a51f-497f-a81e-205a96e45bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:18.543842 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c94a029b-a51f-497f-a81e-205a96e45bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1276 microversion: 2.1 time: 0.320765 Aug 17 07:29:18.563849 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 156/313] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:18 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1276 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:18.860401 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e6c123dc-2b1f-4d2a-9eec-ce061c5231bc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:18.861074 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e6c123dc-2b1f-4d2a-9eec-ce061c5231bc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:18.868840 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e6c123dc-2b1f-4d2a-9eec-ce061c5231bc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:18.869248 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e6c123dc-2b1f-4d2a-9eec-ce061c5231bc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:18.871253 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e6c123dc-2b1f-4d2a-9eec-ce061c5231bc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:18.872417 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e6c123dc-2b1f-4d2a-9eec-ce061c5231bc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:18.885090 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e6c123dc-2b1f-4d2a-9eec-ce061c5231bc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:18.885678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e6c123dc-2b1f-4d2a-9eec-ce061c5231bc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:19.165330 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-e6c123dc-2b1f-4d2a-9eec-ce061c5231bc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:19.194675 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-e6c123dc-2b1f-4d2a-9eec-ce061c5231bc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:19.196881 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-e6c123dc-2b1f-4d2a-9eec-ce061c5231bc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:19.198864 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e6c123dc-2b1f-4d2a-9eec-ce061c5231bc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1738 microversion: 2.20 time: 0.342751 Aug 17 07:29:19.202928 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 158/314] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:18 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1738 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:19.218508 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-4785e6f1-9b44-44fd-9893-aa5872b12c5c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:19.219733 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-4785e6f1-9b44-44fd-9893-aa5872b12c5c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:19.230924 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4785e6f1-9b44-44fd-9893-aa5872b12c5c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:19.231419 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4785e6f1-9b44-44fd-9893-aa5872b12c5c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:19.233014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4785e6f1-9b44-44fd-9893-aa5872b12c5c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:19.237420 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4785e6f1-9b44-44fd-9893-aa5872b12c5c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:19.238367 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4785e6f1-9b44-44fd-9893-aa5872b12c5c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:19.242710 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4785e6f1-9b44-44fd-9893-aa5872b12c5c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:19.499253 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-4785e6f1-9b44-44fd-9893-aa5872b12c5c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:19.512381 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-4785e6f1-9b44-44fd-9893-aa5872b12c5c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1367 microversion: 2.1 time: 0.304547 Aug 17 07:29:19.514617 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 157/315] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:19 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:19.573763 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-eee9d0c2-2c16-4a08-9e03-6a20dbf70eff tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:19.574639 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-eee9d0c2-2c16-4a08-9e03-6a20dbf70eff tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:19.603880 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eee9d0c2-2c16-4a08-9e03-6a20dbf70eff tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:19.604564 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eee9d0c2-2c16-4a08-9e03-6a20dbf70eff tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:19.605238 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eee9d0c2-2c16-4a08-9e03-6a20dbf70eff tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:19.606150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eee9d0c2-2c16-4a08-9e03-6a20dbf70eff tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:19.606753 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eee9d0c2-2c16-4a08-9e03-6a20dbf70eff tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:19.607367 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eee9d0c2-2c16-4a08-9e03-6a20dbf70eff tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:19.909081 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-eee9d0c2-2c16-4a08-9e03-6a20dbf70eff tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:19.923203 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-eee9d0c2-2c16-4a08-9e03-6a20dbf70eff tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1276 microversion: 2.1 time: 0.355245 Aug 17 07:29:19.924375 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 159/316] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:19 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1276 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:20.227944 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-bde04284-3aec-448a-a354-c3b69c5c092c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:20.228563 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-bde04284-3aec-448a-a354-c3b69c5c092c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:20.239703 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:20.241208 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bde04284-3aec-448a-a354-c3b69c5c092c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:20.241774 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bde04284-3aec-448a-a354-c3b69c5c092c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:20.242612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bde04284-3aec-448a-a354-c3b69c5c092c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:20.243495 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bde04284-3aec-448a-a354-c3b69c5c092c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:20.243873 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bde04284-3aec-448a-a354-c3b69c5c092c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:20.244330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bde04284-3aec-448a-a354-c3b69c5c092c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:20.535219 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-6c49cad2-33ca-4be7-b154-a0bd57d458d1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:20.536206 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-6c49cad2-33ca-4be7-b154-a0bd57d458d1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:20.540802 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-bde04284-3aec-448a-a354-c3b69c5c092c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:20.544568 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6c49cad2-33ca-4be7-b154-a0bd57d458d1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:20.545087 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6c49cad2-33ca-4be7-b154-a0bd57d458d1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:20.545538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6c49cad2-33ca-4be7-b154-a0bd57d458d1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:20.555725 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-bde04284-3aec-448a-a354-c3b69c5c092c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:20.557917 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-bde04284-3aec-448a-a354-c3b69c5c092c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:20.561081 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-bde04284-3aec-448a-a354-c3b69c5c092c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1738 microversion: 2.20 time: 0.337058 Aug 17 07:29:20.563454 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6c49cad2-33ca-4be7-b154-a0bd57d458d1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:20.565201 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6c49cad2-33ca-4be7-b154-a0bd57d458d1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:20.570445 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 158/317] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:20 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1738 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:20.574661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6c49cad2-33ca-4be7-b154-a0bd57d458d1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:20.577802 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-3a148a98-6157-4496-94f8-6cec0a60be48 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:20.588278 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3a148a98-6157-4496-94f8-6cec0a60be48 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:20.591999 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3a148a98-6157-4496-94f8-6cec0a60be48 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:20.592660 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3a148a98-6157-4496-94f8-6cec0a60be48 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:20.829190 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-3a148a98-6157-4496-94f8-6cec0a60be48 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Going to try to stop instance {{(pid=120834) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 17 07:29:20.972064 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-3a148a98-6157-4496-94f8-6cec0a60be48 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "POST /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22/action" status: 202 len: 0 microversion: 2.1 time: 0.403195 Aug 17 07:29:20.978415 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 159/318] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 17 07:29:20 2022] POST /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:29:20.997529 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-599c97e7-298c-4003-95bc-f49e5fc2bb05 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:20.998578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-599c97e7-298c-4003-95bc-f49e5fc2bb05 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:21.010012 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-6c49cad2-33ca-4be7-b154-a0bd57d458d1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:21.012967 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=100 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:21.018144 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-599c97e7-298c-4003-95bc-f49e5fc2bb05 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:21.019294 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-599c97e7-298c-4003-95bc-f49e5fc2bb05 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:21.024522 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-599c97e7-298c-4003-95bc-f49e5fc2bb05 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:21.025678 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-599c97e7-298c-4003-95bc-f49e5fc2bb05 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:21.026018 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-6c49cad2-33ca-4be7-b154-a0bd57d458d1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1367 microversion: 2.1 time: 0.494662 Aug 17 07:29:21.030766 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-599c97e7-298c-4003-95bc-f49e5fc2bb05 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:21.031744 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-599c97e7-298c-4003-95bc-f49e5fc2bb05 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:21.039870 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 160/319] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:20 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1367 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:29:21.060853 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-0804e9aa-714c-4cf6-b4d0-3dff883fba47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:21.061614 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-0804e9aa-714c-4cf6-b4d0-3dff883fba47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:21.079641 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0804e9aa-714c-4cf6-b4d0-3dff883fba47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:21.080140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0804e9aa-714c-4cf6-b4d0-3dff883fba47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:21.080583 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0804e9aa-714c-4cf6-b4d0-3dff883fba47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:21.081292 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0804e9aa-714c-4cf6-b4d0-3dff883fba47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:21.081926 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0804e9aa-714c-4cf6-b4d0-3dff883fba47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:21.082567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0804e9aa-714c-4cf6-b4d0-3dff883fba47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:21.349453 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-0804e9aa-714c-4cf6-b4d0-3dff883fba47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:21.362275 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-0804e9aa-714c-4cf6-b4d0-3dff883fba47 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1724 microversion: 2.1 time: 0.314969 Aug 17 07:29:21.366385 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 161/320] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:21 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:21.427449 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-599c97e7-298c-4003-95bc-f49e5fc2bb05 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:21.436597 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-599c97e7-298c-4003-95bc-f49e5fc2bb05 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1264 microversion: 2.1 time: 0.456605 Aug 17 07:29:21.450556 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 160/321] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:20 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1264 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:21.593580 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c9addf94-5d54-4848-a3f7-0bdea88cdd48 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:21.594817 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-c9addf94-5d54-4848-a3f7-0bdea88cdd48 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:21.610076 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c9addf94-5d54-4848-a3f7-0bdea88cdd48 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:21.659455 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c9addf94-5d54-4848-a3f7-0bdea88cdd48 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:21.660210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c9addf94-5d54-4848-a3f7-0bdea88cdd48 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:21.661451 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c9addf94-5d54-4848-a3f7-0bdea88cdd48 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:21.663486 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c9addf94-5d54-4848-a3f7-0bdea88cdd48 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:21.664748 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c9addf94-5d54-4848-a3f7-0bdea88cdd48 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:21.999659 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c9addf94-5d54-4848-a3f7-0bdea88cdd48 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:22.011209 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c9addf94-5d54-4848-a3f7-0bdea88cdd48 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:22.013379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c9addf94-5d54-4848-a3f7-0bdea88cdd48 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:22.016624 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-c9addf94-5d54-4848-a3f7-0bdea88cdd48 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1738 microversion: 2.20 time: 0.427826 Aug 17 07:29:22.032567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 162/322] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:21 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1738 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:22.049856 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a54f2fdc-4b16-4702-ae61-c9cc55986378 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:22.050765 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-a54f2fdc-4b16-4702-ae61-c9cc55986378 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:22.057630 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a54f2fdc-4b16-4702-ae61-c9cc55986378 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:22.058164 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a54f2fdc-4b16-4702-ae61-c9cc55986378 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:22.059237 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a54f2fdc-4b16-4702-ae61-c9cc55986378 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:22.060237 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a54f2fdc-4b16-4702-ae61-c9cc55986378 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:22.060750 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a54f2fdc-4b16-4702-ae61-c9cc55986378 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:22.062372 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a54f2fdc-4b16-4702-ae61-c9cc55986378 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:22.240233 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a54f2fdc-4b16-4702-ae61-c9cc55986378 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:22.251248 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a54f2fdc-4b16-4702-ae61-c9cc55986378 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1367 microversion: 2.1 time: 0.206064 Aug 17 07:29:22.253079 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 161/323] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:22 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:22.385324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-32ebc2fe-b1d5-4175-a7f2-252396a21959 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:22.386371 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-32ebc2fe-b1d5-4175-a7f2-252396a21959 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:22.395317 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-32ebc2fe-b1d5-4175-a7f2-252396a21959 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:22.396798 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-32ebc2fe-b1d5-4175-a7f2-252396a21959 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:22.399079 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-32ebc2fe-b1d5-4175-a7f2-252396a21959 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:22.401753 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-32ebc2fe-b1d5-4175-a7f2-252396a21959 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:22.402724 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-32ebc2fe-b1d5-4175-a7f2-252396a21959 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:22.405215 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-32ebc2fe-b1d5-4175-a7f2-252396a21959 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:22.460953 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-2b63bc64-2769-475b-b1c0-938d6966493f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:22.461929 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-2b63bc64-2769-475b-b1c0-938d6966493f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:22.474372 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2b63bc64-2769-475b-b1c0-938d6966493f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:22.476441 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2b63bc64-2769-475b-b1c0-938d6966493f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:22.476911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2b63bc64-2769-475b-b1c0-938d6966493f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:22.477656 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2b63bc64-2769-475b-b1c0-938d6966493f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:22.483530 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2b63bc64-2769-475b-b1c0-938d6966493f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:22.484052 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2b63bc64-2769-475b-b1c0-938d6966493f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:23.146618 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-32ebc2fe-b1d5-4175-a7f2-252396a21959 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:23.161567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-32ebc2fe-b1d5-4175-a7f2-252396a21959 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1724 microversion: 2.1 time: 0.779828 Aug 17 07:29:23.165134 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 163/324] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:22 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1724 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:23.170016 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-dff384e3-12e5-42cf-9809-f835bc8a103e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:23.176012 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-dff384e3-12e5-42cf-9809-f835bc8a103e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:23.196928 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dff384e3-12e5-42cf-9809-f835bc8a103e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:23.197423 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dff384e3-12e5-42cf-9809-f835bc8a103e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:23.197870 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dff384e3-12e5-42cf-9809-f835bc8a103e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:23.198620 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dff384e3-12e5-42cf-9809-f835bc8a103e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:23.199077 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dff384e3-12e5-42cf-9809-f835bc8a103e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:23.199499 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dff384e3-12e5-42cf-9809-f835bc8a103e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:23.228613 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-2b63bc64-2769-475b-b1c0-938d6966493f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:23.236890 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-2b63bc64-2769-475b-b1c0-938d6966493f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1264 microversion: 2.1 time: 0.780502 Aug 17 07:29:23.243339 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 162/325] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:22 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1264 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:29:23.272550 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-768d4328-32db-4005-84de-8bfe37c02617 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:23.273407 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-768d4328-32db-4005-84de-8bfe37c02617 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:23.293756 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-768d4328-32db-4005-84de-8bfe37c02617 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:23.298534 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-768d4328-32db-4005-84de-8bfe37c02617 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:23.300035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-768d4328-32db-4005-84de-8bfe37c02617 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:23.301055 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-768d4328-32db-4005-84de-8bfe37c02617 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:23.301694 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-768d4328-32db-4005-84de-8bfe37c02617 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:23.302262 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-768d4328-32db-4005-84de-8bfe37c02617 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:23.331689 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:23.508293 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-dff384e3-12e5-42cf-9809-f835bc8a103e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:23.525429 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-dff384e3-12e5-42cf-9809-f835bc8a103e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:23.527884 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-dff384e3-12e5-42cf-9809-f835bc8a103e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:23.529560 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-dff384e3-12e5-42cf-9809-f835bc8a103e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1738 microversion: 2.20 time: 0.363209 Aug 17 07:29:23.530526 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 164/326] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:23 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1738 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:23.662975 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-768d4328-32db-4005-84de-8bfe37c02617 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:23.677244 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-768d4328-32db-4005-84de-8bfe37c02617 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1367 microversion: 2.1 time: 0.407739 Aug 17 07:29:23.679061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 163/327] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:23 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1367 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:29:24.185419 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-341fa1a4-13a4-41ac-869b-ca23c6b7d59f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:24.186639 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-341fa1a4-13a4-41ac-869b-ca23c6b7d59f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:24.196817 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-341fa1a4-13a4-41ac-869b-ca23c6b7d59f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:24.197319 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-341fa1a4-13a4-41ac-869b-ca23c6b7d59f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:24.197765 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-341fa1a4-13a4-41ac-869b-ca23c6b7d59f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:24.198499 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-341fa1a4-13a4-41ac-869b-ca23c6b7d59f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:24.203609 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-341fa1a4-13a4-41ac-869b-ca23c6b7d59f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:24.204070 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-341fa1a4-13a4-41ac-869b-ca23c6b7d59f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:24.267610 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c3beeb0b-eab9-4433-a342-65aab11406ac tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:24.268213 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c3beeb0b-eab9-4433-a342-65aab11406ac tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:24.277279 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c3beeb0b-eab9-4433-a342-65aab11406ac tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:24.277499 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c3beeb0b-eab9-4433-a342-65aab11406ac tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:24.283413 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c3beeb0b-eab9-4433-a342-65aab11406ac tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:24.285394 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c3beeb0b-eab9-4433-a342-65aab11406ac tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:24.286650 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c3beeb0b-eab9-4433-a342-65aab11406ac tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:24.287410 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c3beeb0b-eab9-4433-a342-65aab11406ac tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:24.533516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-341fa1a4-13a4-41ac-869b-ca23c6b7d59f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:24.560311 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-341fa1a4-13a4-41ac-869b-ca23c6b7d59f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1724 microversion: 2.1 time: 0.378974 Aug 17 07:29:24.561861 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 165/328] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:24 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1724 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:24.568042 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-fa01ea46-5208-4cd1-8550-ce6feeef97d9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:24.568655 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-fa01ea46-5208-4cd1-8550-ce6feeef97d9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:24.597526 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fa01ea46-5208-4cd1-8550-ce6feeef97d9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:24.598438 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fa01ea46-5208-4cd1-8550-ce6feeef97d9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:24.599164 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fa01ea46-5208-4cd1-8550-ce6feeef97d9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:24.600116 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fa01ea46-5208-4cd1-8550-ce6feeef97d9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:24.600901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fa01ea46-5208-4cd1-8550-ce6feeef97d9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:24.601441 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fa01ea46-5208-4cd1-8550-ce6feeef97d9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:24.924341 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c3beeb0b-eab9-4433-a342-65aab11406ac tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:24.938913 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c3beeb0b-eab9-4433-a342-65aab11406ac tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1264 microversion: 2.1 time: 0.675389 Aug 17 07:29:24.944698 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 164/329] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:24 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1264 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:29:24.951840 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-bfd6adcf-2a62-4331-86ab-56ff3b5d085d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:24.957659 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-bfd6adcf-2a62-4331-86ab-56ff3b5d085d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:24.983088 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bfd6adcf-2a62-4331-86ab-56ff3b5d085d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:24.983586 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bfd6adcf-2a62-4331-86ab-56ff3b5d085d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:24.986232 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bfd6adcf-2a62-4331-86ab-56ff3b5d085d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:24.986984 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bfd6adcf-2a62-4331-86ab-56ff3b5d085d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:24.989889 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bfd6adcf-2a62-4331-86ab-56ff3b5d085d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:24.992591 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bfd6adcf-2a62-4331-86ab-56ff3b5d085d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:24.999812 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-fa01ea46-5208-4cd1-8550-ce6feeef97d9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:25.011070 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-fa01ea46-5208-4cd1-8550-ce6feeef97d9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:25.012578 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-fa01ea46-5208-4cd1-8550-ce6feeef97d9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:25.025697 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-fa01ea46-5208-4cd1-8550-ce6feeef97d9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1738 microversion: 2.20 time: 0.450347 Aug 17 07:29:25.026407 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 166/330] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:24 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1738 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:25.293724 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-bfd6adcf-2a62-4331-86ab-56ff3b5d085d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:25.307856 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-bfd6adcf-2a62-4331-86ab-56ff3b5d085d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1367 microversion: 2.1 time: 0.358215 Aug 17 07:29:25.330765 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 165/331] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:24 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1367 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:25.582366 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-7d8a2459-bd5a-4fa8-8905-9f37ac874252 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:25.582986 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-7d8a2459-bd5a-4fa8-8905-9f37ac874252 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:25.590512 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7d8a2459-bd5a-4fa8-8905-9f37ac874252 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:25.591274 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7d8a2459-bd5a-4fa8-8905-9f37ac874252 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:25.594185 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7d8a2459-bd5a-4fa8-8905-9f37ac874252 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:25.595196 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7d8a2459-bd5a-4fa8-8905-9f37ac874252 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:25.595837 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7d8a2459-bd5a-4fa8-8905-9f37ac874252 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:25.596430 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7d8a2459-bd5a-4fa8-8905-9f37ac874252 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:25.836834 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-7d8a2459-bd5a-4fa8-8905-9f37ac874252 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:25.849598 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-7d8a2459-bd5a-4fa8-8905-9f37ac874252 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1724 microversion: 2.1 time: 0.269151 Aug 17 07:29:25.865332 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 167/332] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:25 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:25.965368 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ca8a8afc-68d4-4f3b-abba-ca968a5ddd6c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:25.965990 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ca8a8afc-68d4-4f3b-abba-ca968a5ddd6c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:25.976762 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ca8a8afc-68d4-4f3b-abba-ca968a5ddd6c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:25.977513 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ca8a8afc-68d4-4f3b-abba-ca968a5ddd6c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:25.978172 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ca8a8afc-68d4-4f3b-abba-ca968a5ddd6c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:25.981643 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ca8a8afc-68d4-4f3b-abba-ca968a5ddd6c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:25.982932 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ca8a8afc-68d4-4f3b-abba-ca968a5ddd6c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:25.985737 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ca8a8afc-68d4-4f3b-abba-ca968a5ddd6c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:26.053571 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-f35ad292-9570-4495-ae7a-c9cbeb99f7a8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:26.054480 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-f35ad292-9570-4495-ae7a-c9cbeb99f7a8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:26.056758 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=82 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:26.067450 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f35ad292-9570-4495-ae7a-c9cbeb99f7a8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:26.068910 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f35ad292-9570-4495-ae7a-c9cbeb99f7a8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:26.072990 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f35ad292-9570-4495-ae7a-c9cbeb99f7a8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:26.074065 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f35ad292-9570-4495-ae7a-c9cbeb99f7a8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:26.074701 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f35ad292-9570-4495-ae7a-c9cbeb99f7a8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:26.075486 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f35ad292-9570-4495-ae7a-c9cbeb99f7a8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:26.483304 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ca8a8afc-68d4-4f3b-abba-ca968a5ddd6c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:26.497731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ca8a8afc-68d4-4f3b-abba-ca968a5ddd6c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1264 microversion: 2.1 time: 0.536585 Aug 17 07:29:26.504882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 166/333] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:25 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1264 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:26.521879 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-5f81ac45-4e37-4c56-837c-f5d3b4b64929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:26.532558 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-5f81ac45-4e37-4c56-837c-f5d3b4b64929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:26.559423 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5f81ac45-4e37-4c56-837c-f5d3b4b64929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:26.560366 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5f81ac45-4e37-4c56-837c-f5d3b4b64929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:26.561423 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5f81ac45-4e37-4c56-837c-f5d3b4b64929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:26.563787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5f81ac45-4e37-4c56-837c-f5d3b4b64929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:26.566536 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5f81ac45-4e37-4c56-837c-f5d3b4b64929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:26.567164 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5f81ac45-4e37-4c56-837c-f5d3b4b64929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:26.807440 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-f35ad292-9570-4495-ae7a-c9cbeb99f7a8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:26.822017 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-f35ad292-9570-4495-ae7a-c9cbeb99f7a8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:26.828234 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-f35ad292-9570-4495-ae7a-c9cbeb99f7a8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:26.831664 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-f35ad292-9570-4495-ae7a-c9cbeb99f7a8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1738 microversion: 2.20 time: 0.780253 Aug 17 07:29:26.833653 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 168/334] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:26 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1738 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:29:26.879126 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-30e882ba-7ced-45f0-9953-eaf56015148e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:26.880014 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-30e882ba-7ced-45f0-9953-eaf56015148e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:26.916859 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-30e882ba-7ced-45f0-9953-eaf56015148e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:26.918805 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-30e882ba-7ced-45f0-9953-eaf56015148e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:26.919978 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-30e882ba-7ced-45f0-9953-eaf56015148e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:26.922501 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-30e882ba-7ced-45f0-9953-eaf56015148e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:26.924455 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-30e882ba-7ced-45f0-9953-eaf56015148e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:26.925499 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-30e882ba-7ced-45f0-9953-eaf56015148e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:26.967040 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-5f81ac45-4e37-4c56-837c-f5d3b4b64929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:26.978905 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-5f81ac45-4e37-4c56-837c-f5d3b4b64929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1367 microversion: 2.1 time: 0.469735 Aug 17 07:29:26.980647 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 167/335] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:26 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1367 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:27.183979 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-30e882ba-7ced-45f0-9953-eaf56015148e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:27.194003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-30e882ba-7ced-45f0-9953-eaf56015148e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1724 microversion: 2.1 time: 0.325995 Aug 17 07:29:27.194883 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 169/336] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:26 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:27.524866 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-2319648a-7e39-41a2-9cd5-1add8fa70c38 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:27.525515 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-2319648a-7e39-41a2-9cd5-1add8fa70c38 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:27.541804 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2319648a-7e39-41a2-9cd5-1add8fa70c38 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:27.542322 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2319648a-7e39-41a2-9cd5-1add8fa70c38 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:27.542761 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2319648a-7e39-41a2-9cd5-1add8fa70c38 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:27.543479 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2319648a-7e39-41a2-9cd5-1add8fa70c38 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:27.543933 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2319648a-7e39-41a2-9cd5-1add8fa70c38 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:27.544361 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2319648a-7e39-41a2-9cd5-1add8fa70c38 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:27.862408 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9950b89c-7591-4009-a21f-15557f215094 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:27.863070 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-9950b89c-7591-4009-a21f-15557f215094 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:27.879906 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9950b89c-7591-4009-a21f-15557f215094 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:27.880404 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9950b89c-7591-4009-a21f-15557f215094 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:27.880851 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9950b89c-7591-4009-a21f-15557f215094 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:27.881570 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9950b89c-7591-4009-a21f-15557f215094 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:27.882547 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9950b89c-7591-4009-a21f-15557f215094 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:27.893320 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9950b89c-7591-4009-a21f-15557f215094 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:28.574982 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-2319648a-7e39-41a2-9cd5-1add8fa70c38 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:28.594184 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-2319648a-7e39-41a2-9cd5-1add8fa70c38 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1264 microversion: 2.1 time: 1.072982 Aug 17 07:29:28.597650 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 168/337] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:27 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1264 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:28.614733 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-20511310-44fb-4ac4-85ce-6460b5780ec4 req-11c5b556-5129-457a-a793-4e1d933fd130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe690bb-f5a6-4080-aad0-4e79bf213d27", "name": "network-vif-plugged", "status": "completed", "tag": "dbfd8859-14f2-4d83-923c-5789febe3ba4"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:28.638415 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-20511310-44fb-4ac4-85ce-6460b5780ec4 req-11c5b556-5129-457a-a793-4e1d933fd130 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:28.648465 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-20511310-44fb-4ac4-85ce-6460b5780ec4 req-11c5b556-5129-457a-a793-4e1d933fd130 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:28.649255 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-20511310-44fb-4ac4-85ce-6460b5780ec4 req-11c5b556-5129-457a-a793-4e1d933fd130 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:28.664224 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-9950b89c-7591-4009-a21f-15557f215094 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:28.668744 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-20511310-44fb-4ac4-85ce-6460b5780ec4 req-11c5b556-5129-457a-a793-4e1d933fd130 service nova] Creating event network-vif-plugged:dbfd8859-14f2-4d83-923c-5789febe3ba4 for instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 on hv-cinder-85312 Aug 17 07:29:28.680363 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-20511310-44fb-4ac4-85ce-6460b5780ec4 req-11c5b556-5129-457a-a793-4e1d933fd130 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077190 Aug 17 07:29:28.681504 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 169/338] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:29:28.688449 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-9950b89c-7591-4009-a21f-15557f215094 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:28.694031 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-9950b89c-7591-4009-a21f-15557f215094 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:28.695403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-9950b89c-7591-4009-a21f-15557f215094 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1738 microversion: 2.20 time: 0.839929 Aug 17 07:29:28.698810 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 170/339] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:27 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1738 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:29:28.703563 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7e7ad4fb-e4fc-4c4e-8997-255c48415acf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:28.704586 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-7e7ad4fb-e4fc-4c4e-8997-255c48415acf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:28.710047 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-1278a4be-e4a3-4cae-b29b-c1ad40276964 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:28.712030 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-1278a4be-e4a3-4cae-b29b-c1ad40276964 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:28.718629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7e7ad4fb-e4fc-4c4e-8997-255c48415acf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:28.720592 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7e7ad4fb-e4fc-4c4e-8997-255c48415acf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:28.723177 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7e7ad4fb-e4fc-4c4e-8997-255c48415acf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:28.724346 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7e7ad4fb-e4fc-4c4e-8997-255c48415acf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:28.725553 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7e7ad4fb-e4fc-4c4e-8997-255c48415acf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:28.726668 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7e7ad4fb-e4fc-4c4e-8997-255c48415acf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:28.729839 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1278a4be-e4a3-4cae-b29b-c1ad40276964 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:28.733571 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1278a4be-e4a3-4cae-b29b-c1ad40276964 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:28.734514 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1278a4be-e4a3-4cae-b29b-c1ad40276964 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:28.736237 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1278a4be-e4a3-4cae-b29b-c1ad40276964 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:28.736802 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1278a4be-e4a3-4cae-b29b-c1ad40276964 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:28.737333 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1278a4be-e4a3-4cae-b29b-c1ad40276964 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:29.138475 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-7e7ad4fb-e4fc-4c4e-8997-255c48415acf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:29.150903 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-7e7ad4fb-e4fc-4c4e-8997-255c48415acf tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1367 microversion: 2.1 time: 0.459254 Aug 17 07:29:29.151783 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 170/340] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:28 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1367 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:29.193147 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-1278a4be-e4a3-4cae-b29b-c1ad40276964 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:29.203142 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-1278a4be-e4a3-4cae-b29b-c1ad40276964 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1724 microversion: 2.1 time: 0.502524 Aug 17 07:29:29.204059 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 171/341] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:28 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1724 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:29.618675 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-13f6e2e4-a4f5-4066-96da-a25f724fad00 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:29.619577 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-13f6e2e4-a4f5-4066-96da-a25f724fad00 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:29.631283 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-13f6e2e4-a4f5-4066-96da-a25f724fad00 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:29.631986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-13f6e2e4-a4f5-4066-96da-a25f724fad00 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:29.632688 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-13f6e2e4-a4f5-4066-96da-a25f724fad00 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:29.633499 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-13f6e2e4-a4f5-4066-96da-a25f724fad00 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:29.634097 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-13f6e2e4-a4f5-4066-96da-a25f724fad00 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:29.634795 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-13f6e2e4-a4f5-4066-96da-a25f724fad00 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:29.724031 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-5f4d555e-89b5-44ae-9690-66d0613f5213 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:29.724817 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-5f4d555e-89b5-44ae-9690-66d0613f5213 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:29.737012 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5f4d555e-89b5-44ae-9690-66d0613f5213 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:29.738540 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5f4d555e-89b5-44ae-9690-66d0613f5213 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:29.739201 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5f4d555e-89b5-44ae-9690-66d0613f5213 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:29.740134 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5f4d555e-89b5-44ae-9690-66d0613f5213 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:29.740803 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5f4d555e-89b5-44ae-9690-66d0613f5213 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:29.742656 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5f4d555e-89b5-44ae-9690-66d0613f5213 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:30.152192 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-13f6e2e4-a4f5-4066-96da-a25f724fad00 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:30.164794 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-13f6e2e4-a4f5-4066-96da-a25f724fad00 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1264 microversion: 2.1 time: 0.552749 Aug 17 07:29:30.165698 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 171/342] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:29 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1264 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:30.175339 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-d00af5af-36f4-4f63-8532-704ac486c46a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:30.180136 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-d00af5af-36f4-4f63-8532-704ac486c46a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:30.193939 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d00af5af-36f4-4f63-8532-704ac486c46a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:30.194465 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d00af5af-36f4-4f63-8532-704ac486c46a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:30.195217 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d00af5af-36f4-4f63-8532-704ac486c46a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:30.196131 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d00af5af-36f4-4f63-8532-704ac486c46a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:30.200657 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d00af5af-36f4-4f63-8532-704ac486c46a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:30.201896 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d00af5af-36f4-4f63-8532-704ac486c46a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:30.239552 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-5f4d555e-89b5-44ae-9690-66d0613f5213 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:30.249796 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-5f4d555e-89b5-44ae-9690-66d0613f5213 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:30.251357 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-5f4d555e-89b5-44ae-9690-66d0613f5213 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:30.252555 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-5f4d555e-89b5-44ae-9690-66d0613f5213 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1738 microversion: 2.20 time: 0.532808 Aug 17 07:29:30.263291 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 172/343] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:29 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1738 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:29:30.268573 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-53bc2b58-89de-4339-b7a7-8b2b1fe44be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:30.269610 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-53bc2b58-89de-4339-b7a7-8b2b1fe44be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:30.287641 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53bc2b58-89de-4339-b7a7-8b2b1fe44be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:30.289267 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53bc2b58-89de-4339-b7a7-8b2b1fe44be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:30.290063 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53bc2b58-89de-4339-b7a7-8b2b1fe44be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:30.291423 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53bc2b58-89de-4339-b7a7-8b2b1fe44be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:30.292051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53bc2b58-89de-4339-b7a7-8b2b1fe44be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:30.292894 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53bc2b58-89de-4339-b7a7-8b2b1fe44be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:30.610254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-d00af5af-36f4-4f63-8532-704ac486c46a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:30.618680 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-d00af5af-36f4-4f63-8532-704ac486c46a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1367 microversion: 2.1 time: 0.448102 Aug 17 07:29:30.622301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 172/344] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:30 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1367 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:29:30.637580 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-53bc2b58-89de-4339-b7a7-8b2b1fe44be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:30.647704 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-53bc2b58-89de-4339-b7a7-8b2b1fe44be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1724 microversion: 2.1 time: 0.382512 Aug 17 07:29:30.648950 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 173/345] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:30 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1724 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:31.185723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ec4c5b43-ba21-4ce7-b1df-5f7105c86081 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:31.186682 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ec4c5b43-ba21-4ce7-b1df-5f7105c86081 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:31.197830 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ec4c5b43-ba21-4ce7-b1df-5f7105c86081 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:31.199617 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ec4c5b43-ba21-4ce7-b1df-5f7105c86081 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:31.200710 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ec4c5b43-ba21-4ce7-b1df-5f7105c86081 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:31.203467 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ec4c5b43-ba21-4ce7-b1df-5f7105c86081 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:31.204579 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ec4c5b43-ba21-4ce7-b1df-5f7105c86081 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:31.208086 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ec4c5b43-ba21-4ce7-b1df-5f7105c86081 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:31.289952 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-4ad72d30-a6a2-4b18-9604-096437b82dda tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:31.290642 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-4ad72d30-a6a2-4b18-9604-096437b82dda tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:31.303341 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4ad72d30-a6a2-4b18-9604-096437b82dda tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:31.306592 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4ad72d30-a6a2-4b18-9604-096437b82dda tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:31.310238 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4ad72d30-a6a2-4b18-9604-096437b82dda tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:31.311762 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4ad72d30-a6a2-4b18-9604-096437b82dda tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:31.315055 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4ad72d30-a6a2-4b18-9604-096437b82dda tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:31.315565 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4ad72d30-a6a2-4b18-9604-096437b82dda tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:31.731978 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ec4c5b43-ba21-4ce7-b1df-5f7105c86081 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:31.765063 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ec4c5b43-ba21-4ce7-b1df-5f7105c86081 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1264 microversion: 2.1 time: 0.582453 Aug 17 07:29:31.790761 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 173/346] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:31 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1264 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:31.808953 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f2a2e765-d66a-479e-a810-1d85ede3aeaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:31.810993 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f2a2e765-d66a-479e-a810-1d85ede3aeaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:31.834569 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f2a2e765-d66a-479e-a810-1d85ede3aeaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:31.838986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f2a2e765-d66a-479e-a810-1d85ede3aeaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:31.838986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f2a2e765-d66a-479e-a810-1d85ede3aeaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:31.838986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f2a2e765-d66a-479e-a810-1d85ede3aeaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:31.838986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f2a2e765-d66a-479e-a810-1d85ede3aeaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:31.839493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f2a2e765-d66a-479e-a810-1d85ede3aeaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:31.849512 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-4ad72d30-a6a2-4b18-9604-096437b82dda tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:31.857918 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-4ad72d30-a6a2-4b18-9604-096437b82dda tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:31.860240 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-4ad72d30-a6a2-4b18-9604-096437b82dda tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:31.862317 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-4ad72d30-a6a2-4b18-9604-096437b82dda tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1738 microversion: 2.20 time: 0.576669 Aug 17 07:29:31.863511 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 174/347] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:31 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1738 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:29:31.869771 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-141035e4-be74-4055-8515-ebbb6691757a tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:31.870745 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-141035e4-be74-4055-8515-ebbb6691757a tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:31.887396 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-141035e4-be74-4055-8515-ebbb6691757a tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:31.890327 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-141035e4-be74-4055-8515-ebbb6691757a tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:31.891723 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-141035e4-be74-4055-8515-ebbb6691757a tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:31.892636 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-141035e4-be74-4055-8515-ebbb6691757a tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:31.894810 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-141035e4-be74-4055-8515-ebbb6691757a tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:31.897275 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-141035e4-be74-4055-8515-ebbb6691757a tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:32.313378 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f2a2e765-d66a-479e-a810-1d85ede3aeaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:32.341610 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f2a2e765-d66a-479e-a810-1d85ede3aeaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1557 microversion: 2.1 time: 0.549363 Aug 17 07:29:32.351605 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 174/348] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:31 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1557 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:32.381468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1adc164a-b1f8-4577-a483-e0d3a28aec38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:32.381984 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-1adc164a-b1f8-4577-a483-e0d3a28aec38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:32.418391 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-141035e4-be74-4055-8515-ebbb6691757a tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:32.423008 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1adc164a-b1f8-4577-a483-e0d3a28aec38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:32.436299 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1adc164a-b1f8-4577-a483-e0d3a28aec38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:32.442409 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1adc164a-b1f8-4577-a483-e0d3a28aec38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:32.444434 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1adc164a-b1f8-4577-a483-e0d3a28aec38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:32.445815 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-141035e4-be74-4055-8515-ebbb6691757a tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1724 microversion: 2.1 time: 0.581070 Aug 17 07:29:32.446443 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 175/349] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:31 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1724 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:32.448412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1adc164a-b1f8-4577-a483-e0d3a28aec38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:32.453241 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1adc164a-b1f8-4577-a483-e0d3a28aec38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:32.666182 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-1adc164a-b1f8-4577-a483-e0d3a28aec38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.294320 Aug 17 07:29:32.675712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 175/350] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 17 07:29:32 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27/os-interface => generated 284 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:29:32.805425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-48af9f76-f816-4f41-badb-db917b87b0bd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:32.806212 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-48af9f76-f816-4f41-badb-db917b87b0bd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:32.816641 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-48af9f76-f816-4f41-badb-db917b87b0bd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:32.820766 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-48af9f76-f816-4f41-badb-db917b87b0bd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:32.821222 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-48af9f76-f816-4f41-badb-db917b87b0bd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:32.822014 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-48af9f76-f816-4f41-badb-db917b87b0bd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:32.822443 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-48af9f76-f816-4f41-badb-db917b87b0bd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:32.830059 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-48af9f76-f816-4f41-badb-db917b87b0bd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:32.886103 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-d5534ea3-2c00-4fc5-8ed5-69a271b5dc72 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:32.886698 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-d5534ea3-2c00-4fc5-8ed5-69a271b5dc72 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:32.894953 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d5534ea3-2c00-4fc5-8ed5-69a271b5dc72 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:32.906139 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d5534ea3-2c00-4fc5-8ed5-69a271b5dc72 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:32.907683 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d5534ea3-2c00-4fc5-8ed5-69a271b5dc72 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:32.917505 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d5534ea3-2c00-4fc5-8ed5-69a271b5dc72 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:32.918426 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d5534ea3-2c00-4fc5-8ed5-69a271b5dc72 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:32.919167 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d5534ea3-2c00-4fc5-8ed5-69a271b5dc72 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:33.346574 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-48af9f76-f816-4f41-badb-db917b87b0bd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:33.354579 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-48af9f76-f816-4f41-badb-db917b87b0bd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1264 microversion: 2.1 time: 0.553213 Aug 17 07:29:33.354748 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 176/351] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:32 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1264 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:33.370339 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-d5534ea3-2c00-4fc5-8ed5-69a271b5dc72 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:33.381427 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-d5534ea3-2c00-4fc5-8ed5-69a271b5dc72 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:33.386992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-d5534ea3-2c00-4fc5-8ed5-69a271b5dc72 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:33.388301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-d5534ea3-2c00-4fc5-8ed5-69a271b5dc72 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1738 microversion: 2.20 time: 0.506007 Aug 17 07:29:33.389091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 176/352] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:32 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1738 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:29:33.468563 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-43366ca8-d4cf-4784-8593-0866e13054e5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:33.469174 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-43366ca8-d4cf-4784-8593-0866e13054e5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:33.481810 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-43366ca8-d4cf-4784-8593-0866e13054e5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:33.482877 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-43366ca8-d4cf-4784-8593-0866e13054e5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:33.483316 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-43366ca8-d4cf-4784-8593-0866e13054e5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:33.484023 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-43366ca8-d4cf-4784-8593-0866e13054e5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:33.484475 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-43366ca8-d4cf-4784-8593-0866e13054e5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:33.484896 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-43366ca8-d4cf-4784-8593-0866e13054e5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:33.525593 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-29811ee9-74d4-49e9-b87a-69617ffe04b5 req-a7e7ce91-3d1a-427f-8ce8-0e9efddfe514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da23597a-1e52-4e8a-bd7b-28bd175471ae", "name": "network-vif-plugged", "status": "completed", "tag": "38d23e53-70d4-4b98-ae25-a473ae03bd51"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:33.537153 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=100 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:33.544027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-29811ee9-74d4-49e9-b87a-69617ffe04b5 req-a7e7ce91-3d1a-427f-8ce8-0e9efddfe514 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:33.544503 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-29811ee9-74d4-49e9-b87a-69617ffe04b5 req-a7e7ce91-3d1a-427f-8ce8-0e9efddfe514 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:33.545585 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-29811ee9-74d4-49e9-b87a-69617ffe04b5 req-a7e7ce91-3d1a-427f-8ce8-0e9efddfe514 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:33.573952 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-29811ee9-74d4-49e9-b87a-69617ffe04b5 req-a7e7ce91-3d1a-427f-8ce8-0e9efddfe514 service nova] Creating event network-vif-plugged:38d23e53-70d4-4b98-ae25-a473ae03bd51 for instance da23597a-1e52-4e8a-bd7b-28bd175471ae on hv-cinder-85312 Aug 17 07:29:33.586473 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-29811ee9-74d4-49e9-b87a-69617ffe04b5 req-a7e7ce91-3d1a-427f-8ce8-0e9efddfe514 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064369 Aug 17 07:29:33.609463 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 177/353] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:29:33.820509 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-43366ca8-d4cf-4784-8593-0866e13054e5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:33.831498 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-43366ca8-d4cf-4784-8593-0866e13054e5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1724 microversion: 2.1 time: 0.366729 Aug 17 07:29:33.832752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 177/354] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:33 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:34.379763 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-54b59d7f-86a1-4823-8d01-d8868b15e56c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:34.381166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-54b59d7f-86a1-4823-8d01-d8868b15e56c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:34.395939 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-54b59d7f-86a1-4823-8d01-d8868b15e56c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:34.396744 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-54b59d7f-86a1-4823-8d01-d8868b15e56c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:34.397360 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-54b59d7f-86a1-4823-8d01-d8868b15e56c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:34.398278 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-54b59d7f-86a1-4823-8d01-d8868b15e56c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:34.398909 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-54b59d7f-86a1-4823-8d01-d8868b15e56c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:34.399659 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-54b59d7f-86a1-4823-8d01-d8868b15e56c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:34.411184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c17c71a7-06b5-42d9-8291-e0f793aeff64 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:34.412054 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-c17c71a7-06b5-42d9-8291-e0f793aeff64 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:34.433130 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c17c71a7-06b5-42d9-8291-e0f793aeff64 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:34.433720 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c17c71a7-06b5-42d9-8291-e0f793aeff64 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:34.434359 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c17c71a7-06b5-42d9-8291-e0f793aeff64 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:34.439000 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c17c71a7-06b5-42d9-8291-e0f793aeff64 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:34.439705 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c17c71a7-06b5-42d9-8291-e0f793aeff64 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:34.440250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c17c71a7-06b5-42d9-8291-e0f793aeff64 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:34.744156 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-54b59d7f-86a1-4823-8d01-d8868b15e56c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:34.752498 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-54b59d7f-86a1-4823-8d01-d8868b15e56c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1264 microversion: 2.1 time: 0.380112 Aug 17 07:29:34.753076 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 178/355] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:34 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1264 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:34.779310 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-61ee6477-c3c6-4568-83b5-9a6126d1e5ed req-41896469-7fee-479d-8a74-b8ca85c6630e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe690bb-f5a6-4080-aad0-4e79bf213d27", "tag": "dbfd8859-14f2-4d83-923c-5789febe3ba4"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:34.803139 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-61ee6477-c3c6-4568-83b5-9a6126d1e5ed req-41896469-7fee-479d-8a74-b8ca85c6630e service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:34.803576 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-61ee6477-c3c6-4568-83b5-9a6126d1e5ed req-41896469-7fee-479d-8a74-b8ca85c6630e service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:34.804181 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-61ee6477-c3c6-4568-83b5-9a6126d1e5ed req-41896469-7fee-479d-8a74-b8ca85c6630e service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:34.818868 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-61ee6477-c3c6-4568-83b5-9a6126d1e5ed req-41896469-7fee-479d-8a74-b8ca85c6630e service nova] Creating event network-changed:dbfd8859-14f2-4d83-923c-5789febe3ba4 for instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 on hv-cinder-85312 Aug 17 07:29:34.825782 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-61ee6477-c3c6-4568-83b5-9a6126d1e5ed req-41896469-7fee-479d-8a74-b8ca85c6630e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052876 Aug 17 07:29:34.831119 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 179/356] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:29:34.840041 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c17c71a7-06b5-42d9-8291-e0f793aeff64 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:34.851236 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c17c71a7-06b5-42d9-8291-e0f793aeff64 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:34.853042 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c17c71a7-06b5-42d9-8291-e0f793aeff64 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:34.854491 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-c17c71a7-06b5-42d9-8291-e0f793aeff64 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1720 microversion: 2.20 time: 0.447188 Aug 17 07:29:34.855631 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 178/357] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:34 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1720 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:34.860235 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c5337b17-b3d3-4e0f-9e83-9ccdbd10d513 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:34.861192 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c5337b17-b3d3-4e0f-9e83-9ccdbd10d513 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:34.868864 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c5337b17-b3d3-4e0f-9e83-9ccdbd10d513 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:34.869681 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c5337b17-b3d3-4e0f-9e83-9ccdbd10d513 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:34.870650 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c5337b17-b3d3-4e0f-9e83-9ccdbd10d513 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:34.871628 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c5337b17-b3d3-4e0f-9e83-9ccdbd10d513 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:34.872403 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c5337b17-b3d3-4e0f-9e83-9ccdbd10d513 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:34.873891 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c5337b17-b3d3-4e0f-9e83-9ccdbd10d513 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:35.070781 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c5337b17-b3d3-4e0f-9e83-9ccdbd10d513 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:35.080510 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c5337b17-b3d3-4e0f-9e83-9ccdbd10d513 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1724 microversion: 2.1 time: 0.230139 Aug 17 07:29:35.089669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 180/358] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:34 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:35.773346 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a211757a-7860-45de-a630-2eb8393360fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:35.774053 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a211757a-7860-45de-a630-2eb8393360fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:35.782855 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a211757a-7860-45de-a630-2eb8393360fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:35.794176 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a211757a-7860-45de-a630-2eb8393360fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:35.795135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a211757a-7860-45de-a630-2eb8393360fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:35.795945 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a211757a-7860-45de-a630-2eb8393360fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:35.796436 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a211757a-7860-45de-a630-2eb8393360fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:35.796868 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a211757a-7860-45de-a630-2eb8393360fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:35.880331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-8aba370f-2047-475c-bb12-de08948bf44c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:35.881538 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-8aba370f-2047-475c-bb12-de08948bf44c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:35.895866 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8aba370f-2047-475c-bb12-de08948bf44c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:35.897021 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8aba370f-2047-475c-bb12-de08948bf44c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:35.897457 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8aba370f-2047-475c-bb12-de08948bf44c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:35.898198 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8aba370f-2047-475c-bb12-de08948bf44c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:35.907047 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8aba370f-2047-475c-bb12-de08948bf44c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:35.909385 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8aba370f-2047-475c-bb12-de08948bf44c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:36.093510 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a211757a-7860-45de-a630-2eb8393360fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:36.101397 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a211757a-7860-45de-a630-2eb8393360fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1264 microversion: 2.1 time: 0.331940 Aug 17 07:29:36.102001 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 179/359] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:35 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1264 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:36.110112 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a6cc1830-2593-44f0-8d9d-ba9341ce188f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:36.110984 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a6cc1830-2593-44f0-8d9d-ba9341ce188f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:36.133484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a6cc1830-2593-44f0-8d9d-ba9341ce188f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:36.134053 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a6cc1830-2593-44f0-8d9d-ba9341ce188f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:36.134487 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a6cc1830-2593-44f0-8d9d-ba9341ce188f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:36.135201 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a6cc1830-2593-44f0-8d9d-ba9341ce188f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:36.135665 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a6cc1830-2593-44f0-8d9d-ba9341ce188f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:36.136094 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a6cc1830-2593-44f0-8d9d-ba9341ce188f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:36.257752 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-8aba370f-2047-475c-bb12-de08948bf44c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:36.266066 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-8aba370f-2047-475c-bb12-de08948bf44c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:36.271170 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-8aba370f-2047-475c-bb12-de08948bf44c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:36.273431 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-8aba370f-2047-475c-bb12-de08948bf44c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1720 microversion: 2.20 time: 0.396954 Aug 17 07:29:36.289781 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 181/360] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:35 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1720 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:29:36.428243 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a6cc1830-2593-44f0-8d9d-ba9341ce188f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:36.438542 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a6cc1830-2593-44f0-8d9d-ba9341ce188f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1724 microversion: 2.1 time: 0.331517 Aug 17 07:29:36.439122 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 180/361] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:36 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1724 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:37.123771 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-61444da4-aacc-4dac-8a4f-570406d8191a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:37.125223 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-61444da4-aacc-4dac-8a4f-570406d8191a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:37.152075 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-61444da4-aacc-4dac-8a4f-570406d8191a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:37.155809 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-61444da4-aacc-4dac-8a4f-570406d8191a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:37.156667 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-61444da4-aacc-4dac-8a4f-570406d8191a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:37.157585 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-61444da4-aacc-4dac-8a4f-570406d8191a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:37.158472 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-61444da4-aacc-4dac-8a4f-570406d8191a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:37.159116 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-61444da4-aacc-4dac-8a4f-570406d8191a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:37.180341 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=100 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:37.308825 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b7ecb915-722b-41ee-b1ee-5e239da3cf68 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:37.309420 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-b7ecb915-722b-41ee-b1ee-5e239da3cf68 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:37.325146 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b7ecb915-722b-41ee-b1ee-5e239da3cf68 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:37.326467 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b7ecb915-722b-41ee-b1ee-5e239da3cf68 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:37.327119 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b7ecb915-722b-41ee-b1ee-5e239da3cf68 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:37.328094 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b7ecb915-722b-41ee-b1ee-5e239da3cf68 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:37.328544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b7ecb915-722b-41ee-b1ee-5e239da3cf68 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:37.328968 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b7ecb915-722b-41ee-b1ee-5e239da3cf68 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:37.376818 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-61444da4-aacc-4dac-8a4f-570406d8191a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:37.386082 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-61444da4-aacc-4dac-8a4f-570406d8191a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1450 microversion: 2.1 time: 0.267358 Aug 17 07:29:37.386676 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 182/362] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:37 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1450 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:37.402122 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-91cb7314-afa8-4ee3-a4b9-b9392b16e9e5 req-825c5912-af22-4afd-8c15-909ed0d8419a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebfec5b-68c1-41cd-910b-e73220fc2fd6", "name": "network-vif-unplugged", "status": "completed", "tag": "dc7af87b-fe16-4334-a953-7e5e2d03e8e7"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:37.424257 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-91cb7314-afa8-4ee3-a4b9-b9392b16e9e5 req-825c5912-af22-4afd-8c15-909ed0d8419a service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:37.425093 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-91cb7314-afa8-4ee3-a4b9-b9392b16e9e5 req-825c5912-af22-4afd-8c15-909ed0d8419a service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:37.425605 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-91cb7314-afa8-4ee3-a4b9-b9392b16e9e5 req-825c5912-af22-4afd-8c15-909ed0d8419a service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:37.461754 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-91cb7314-afa8-4ee3-a4b9-b9392b16e9e5 req-825c5912-af22-4afd-8c15-909ed0d8419a service nova] Creating event network-vif-unplugged:dc7af87b-fe16-4334-a953-7e5e2d03e8e7 for instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 on hv-cinder-85312 Aug 17 07:29:37.476301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-91cb7314-afa8-4ee3-a4b9-b9392b16e9e5 req-825c5912-af22-4afd-8c15-909ed0d8419a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088349 Aug 17 07:29:37.477297 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 183/363] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:29:37.484697 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c885184d-b44b-48d0-9f0c-fbcd985db297 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:37.485611 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c885184d-b44b-48d0-9f0c-fbcd985db297 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:37.493654 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c885184d-b44b-48d0-9f0c-fbcd985db297 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:37.494293 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c885184d-b44b-48d0-9f0c-fbcd985db297 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:37.494988 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c885184d-b44b-48d0-9f0c-fbcd985db297 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:37.495786 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c885184d-b44b-48d0-9f0c-fbcd985db297 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:37.496680 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c885184d-b44b-48d0-9f0c-fbcd985db297 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:37.497188 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c885184d-b44b-48d0-9f0c-fbcd985db297 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:37.597709 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b7ecb915-722b-41ee-b1ee-5e239da3cf68 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:37.606734 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b7ecb915-722b-41ee-b1ee-5e239da3cf68 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:37.608573 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b7ecb915-722b-41ee-b1ee-5e239da3cf68 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:37.609741 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b7ecb915-722b-41ee-b1ee-5e239da3cf68 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1720 microversion: 2.20 time: 0.305101 Aug 17 07:29:37.625725 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 181/364] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:37 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1720 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:37.634914 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b860eb00-8f34-4526-9e9e-b68729e65800 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:37.635881 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-b860eb00-8f34-4526-9e9e-b68729e65800 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:37.643328 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b860eb00-8f34-4526-9e9e-b68729e65800 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:37.644034 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b860eb00-8f34-4526-9e9e-b68729e65800 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:37.644638 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b860eb00-8f34-4526-9e9e-b68729e65800 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:37.645563 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b860eb00-8f34-4526-9e9e-b68729e65800 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:37.646196 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b860eb00-8f34-4526-9e9e-b68729e65800 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:37.646773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b860eb00-8f34-4526-9e9e-b68729e65800 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:37.664701 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c885184d-b44b-48d0-9f0c-fbcd985db297 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:37.674915 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c885184d-b44b-48d0-9f0c-fbcd985db297 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1450 microversion: 2.1 time: 0.196069 Aug 17 07:29:37.678005 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 184/365] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:37 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1450 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:37.799081 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b860eb00-8f34-4526-9e9e-b68729e65800 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:37.810986 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b860eb00-8f34-4526-9e9e-b68729e65800 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1724 microversion: 2.1 time: 0.183281 Aug 17 07:29:37.811922 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 182/366] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:37 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:38.633278 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-aaa0b84f-e2f2-4be2-9241-2101e0a2c501 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:38.633758 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-aaa0b84f-e2f2-4be2-9241-2101e0a2c501 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:38.647739 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aaa0b84f-e2f2-4be2-9241-2101e0a2c501 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:38.648230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aaa0b84f-e2f2-4be2-9241-2101e0a2c501 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:38.648661 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aaa0b84f-e2f2-4be2-9241-2101e0a2c501 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:38.649357 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aaa0b84f-e2f2-4be2-9241-2101e0a2c501 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:38.653276 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aaa0b84f-e2f2-4be2-9241-2101e0a2c501 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:38.656479 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aaa0b84f-e2f2-4be2-9241-2101e0a2c501 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:38.833148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d8632271-ae44-4baf-a557-e829795b9db2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:38.833708 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d8632271-ae44-4baf-a557-e829795b9db2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:38.844214 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d8632271-ae44-4baf-a557-e829795b9db2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:38.845056 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d8632271-ae44-4baf-a557-e829795b9db2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:38.845694 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d8632271-ae44-4baf-a557-e829795b9db2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:38.846641 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d8632271-ae44-4baf-a557-e829795b9db2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:38.847439 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d8632271-ae44-4baf-a557-e829795b9db2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:38.848084 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d8632271-ae44-4baf-a557-e829795b9db2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:39.120690 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-aaa0b84f-e2f2-4be2-9241-2101e0a2c501 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:39.134533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-aaa0b84f-e2f2-4be2-9241-2101e0a2c501 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:39.140678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d8632271-ae44-4baf-a557-e829795b9db2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:39.149645 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d8632271-ae44-4baf-a557-e829795b9db2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1724 microversion: 2.1 time: 0.321092 Aug 17 07:29:39.151181 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-aaa0b84f-e2f2-4be2-9241-2101e0a2c501 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:39.152362 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-aaa0b84f-e2f2-4be2-9241-2101e0a2c501 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1720 microversion: 2.20 time: 0.523248 Aug 17 07:29:39.158691 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 183/367] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:38 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1724 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:29:39.159743 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 185/368] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:38 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1720 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:40.160185 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-55f442aa-7466-4383-a325-21c5eb98feca req-9b765e25-6b84-458d-87cc-25b0ec318d49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da23597a-1e52-4e8a-bd7b-28bd175471ae", "tag": "38d23e53-70d4-4b98-ae25-a473ae03bd51"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:40.171535 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-55f442aa-7466-4383-a325-21c5eb98feca req-9b765e25-6b84-458d-87cc-25b0ec318d49 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:40.172356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-55f442aa-7466-4383-a325-21c5eb98feca req-9b765e25-6b84-458d-87cc-25b0ec318d49 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:40.172850 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-55f442aa-7466-4383-a325-21c5eb98feca req-9b765e25-6b84-458d-87cc-25b0ec318d49 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:40.186091 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-55f442aa-7466-4383-a325-21c5eb98feca req-9b765e25-6b84-458d-87cc-25b0ec318d49 service nova] Creating event network-changed:38d23e53-70d4-4b98-ae25-a473ae03bd51 for instance da23597a-1e52-4e8a-bd7b-28bd175471ae on hv-cinder-85312 Aug 17 07:29:40.192009 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0cfdf171-0b65-44c2-8f01-aca1cdae12a4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:40.193263 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0cfdf171-0b65-44c2-8f01-aca1cdae12a4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:40.200226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0cfdf171-0b65-44c2-8f01-aca1cdae12a4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:40.201111 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0cfdf171-0b65-44c2-8f01-aca1cdae12a4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:40.201756 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0cfdf171-0b65-44c2-8f01-aca1cdae12a4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:40.202751 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0cfdf171-0b65-44c2-8f01-aca1cdae12a4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:40.203269 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0cfdf171-0b65-44c2-8f01-aca1cdae12a4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:40.203753 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0cfdf171-0b65-44c2-8f01-aca1cdae12a4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:40.212647 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-55f442aa-7466-4383-a325-21c5eb98feca req-9b765e25-6b84-458d-87cc-25b0ec318d49 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060856 Aug 17 07:29:40.213260 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 184/369] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:29:40.221693 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3d98016b-c510-4118-970a-93bc307ce91b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:40.230382 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-3d98016b-c510-4118-970a-93bc307ce91b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:40.258448 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3d98016b-c510-4118-970a-93bc307ce91b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:40.259230 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3d98016b-c510-4118-970a-93bc307ce91b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:40.259755 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3d98016b-c510-4118-970a-93bc307ce91b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:40.260591 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3d98016b-c510-4118-970a-93bc307ce91b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:40.261118 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3d98016b-c510-4118-970a-93bc307ce91b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:40.261620 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3d98016b-c510-4118-970a-93bc307ce91b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:40.545381 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0cfdf171-0b65-44c2-8f01-aca1cdae12a4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:40.558815 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0cfdf171-0b65-44c2-8f01-aca1cdae12a4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1724 microversion: 2.1 time: 0.370504 Aug 17 07:29:40.559399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 186/370] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:40 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1724 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:29:40.589062 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3d98016b-c510-4118-970a-93bc307ce91b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:40.598728 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3d98016b-c510-4118-970a-93bc307ce91b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:40.600715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3d98016b-c510-4118-970a-93bc307ce91b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:40.602042 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-3d98016b-c510-4118-970a-93bc307ce91b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1663 microversion: 2.20 time: 0.384586 Aug 17 07:29:40.602685 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 185/371] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:40 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1663 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:40.627891 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b756f181-3f6f-4299-829c-7455f5ff84cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8db163f1-9497-4274-b8d1-053192895161"}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:40.630306 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-b756f181-3f6f-4299-829c-7455f5ff84cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:40.643741 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b756f181-3f6f-4299-829c-7455f5ff84cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:40.644226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b756f181-3f6f-4299-829c-7455f5ff84cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:40.644668 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b756f181-3f6f-4299-829c-7455f5ff84cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:40.645384 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b756f181-3f6f-4299-829c-7455f5ff84cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:40.645829 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b756f181-3f6f-4299-829c-7455f5ff84cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:40.646274 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b756f181-3f6f-4299-829c-7455f5ff84cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:41.066915 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b756f181-3f6f-4299-829c-7455f5ff84cb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "POST /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.442754 Aug 17 07:29:41.067967 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 187/372] 10.222.0.45 () {62 vars in 1364 bytes} [Wed Aug 17 07:29:40 2022] POST /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6/os-volume_attachments => generated 188 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 07:29:41.227681 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-53dae87b-b95e-49bb-801d-af24c1ce3445 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:41.228885 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-53dae87b-b95e-49bb-801d-af24c1ce3445 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:41.242341 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53dae87b-b95e-49bb-801d-af24c1ce3445 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:41.243088 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53dae87b-b95e-49bb-801d-af24c1ce3445 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:41.243726 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53dae87b-b95e-49bb-801d-af24c1ce3445 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:41.245063 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53dae87b-b95e-49bb-801d-af24c1ce3445 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:41.245890 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53dae87b-b95e-49bb-801d-af24c1ce3445 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:41.247713 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53dae87b-b95e-49bb-801d-af24c1ce3445 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:41.301665 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-53dae87b-b95e-49bb-801d-af24c1ce3445 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120835) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 07:29:41.400183 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-53dae87b-b95e-49bb-801d-af24c1ce3445 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "POST /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6/action" status: 202 len: 0 microversion: 2.20 time: 0.176616 Aug 17 07:29:41.400787 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 186/373] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 17 07:29:41 2022] POST /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:29:41.409688 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-277188c1-82a1-4bb8-bb45-a5f786ed1c6a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:41.411289 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-277188c1-82a1-4bb8-bb45-a5f786ed1c6a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:41.422421 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-277188c1-82a1-4bb8-bb45-a5f786ed1c6a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:41.425115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-277188c1-82a1-4bb8-bb45-a5f786ed1c6a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:41.427787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-277188c1-82a1-4bb8-bb45-a5f786ed1c6a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:41.428744 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-277188c1-82a1-4bb8-bb45-a5f786ed1c6a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:41.431546 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-277188c1-82a1-4bb8-bb45-a5f786ed1c6a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:41.432177 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-277188c1-82a1-4bb8-bb45-a5f786ed1c6a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:41.579803 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ee615fbc-1d74-4afe-b6f2-ab4d470b6bd7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:41.580556 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-ee615fbc-1d74-4afe-b6f2-ab4d470b6bd7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:41.594692 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ee615fbc-1d74-4afe-b6f2-ab4d470b6bd7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:41.595197 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ee615fbc-1d74-4afe-b6f2-ab4d470b6bd7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:41.596382 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ee615fbc-1d74-4afe-b6f2-ab4d470b6bd7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:41.597215 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ee615fbc-1d74-4afe-b6f2-ab4d470b6bd7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:41.597663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ee615fbc-1d74-4afe-b6f2-ab4d470b6bd7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:41.598438 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ee615fbc-1d74-4afe-b6f2-ab4d470b6bd7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:41.702853 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-277188c1-82a1-4bb8-bb45-a5f786ed1c6a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:41.720210 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-277188c1-82a1-4bb8-bb45-a5f786ed1c6a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:41.723047 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-277188c1-82a1-4bb8-bb45-a5f786ed1c6a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:41.727999 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-277188c1-82a1-4bb8-bb45-a5f786ed1c6a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1749 microversion: 2.20 time: 0.322204 Aug 17 07:29:41.731242 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 188/374] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:41 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1749 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:41.828604 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ee615fbc-1d74-4afe-b6f2-ab4d470b6bd7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:41.839652 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-ee615fbc-1d74-4afe-b6f2-ab4d470b6bd7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1724 microversion: 2.1 time: 0.263718 Aug 17 07:29:41.853487 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 187/375] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:41 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:42.756910 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ee7c3bf6-0701-418b-a6c0-0f7558c54e1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:42.758718 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ee7c3bf6-0701-418b-a6c0-0f7558c54e1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:42.768291 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee7c3bf6-0701-418b-a6c0-0f7558c54e1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:42.769149 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee7c3bf6-0701-418b-a6c0-0f7558c54e1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:42.770209 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee7c3bf6-0701-418b-a6c0-0f7558c54e1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:42.770908 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee7c3bf6-0701-418b-a6c0-0f7558c54e1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:42.771388 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee7c3bf6-0701-418b-a6c0-0f7558c54e1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:42.772143 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee7c3bf6-0701-418b-a6c0-0f7558c54e1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:42.861503 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a0b07ac8-0545-4b5d-89ee-e1bd725beb3e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:42.862156 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a0b07ac8-0545-4b5d-89ee-e1bd725beb3e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:42.873593 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a0b07ac8-0545-4b5d-89ee-e1bd725beb3e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:42.874107 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a0b07ac8-0545-4b5d-89ee-e1bd725beb3e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:42.876401 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a0b07ac8-0545-4b5d-89ee-e1bd725beb3e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:42.879132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a0b07ac8-0545-4b5d-89ee-e1bd725beb3e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:42.879904 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a0b07ac8-0545-4b5d-89ee-e1bd725beb3e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:42.884078 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a0b07ac8-0545-4b5d-89ee-e1bd725beb3e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:43.005361 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ee7c3bf6-0701-418b-a6c0-0f7558c54e1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:43.016353 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ee7c3bf6-0701-418b-a6c0-0f7558c54e1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:43.018755 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ee7c3bf6-0701-418b-a6c0-0f7558c54e1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:43.020213 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ee7c3bf6-0701-418b-a6c0-0f7558c54e1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1751 microversion: 2.20 time: 0.268476 Aug 17 07:29:43.020863 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 189/376] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:42 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1751 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:43.075201 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a0b07ac8-0545-4b5d-89ee-e1bd725beb3e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:43.084104 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a0b07ac8-0545-4b5d-89ee-e1bd725beb3e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1701 microversion: 2.1 time: 0.227282 Aug 17 07:29:43.094128 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 188/377] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:42 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1701 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:29:43.106846 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-cf6b1214-6af0-453e-b6c3-5d3b5fec3c10 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:43.113056 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cf6b1214-6af0-453e-b6c3-5d3b5fec3c10 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:43.113540 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cf6b1214-6af0-453e-b6c3-5d3b5fec3c10 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:43.113991 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cf6b1214-6af0-453e-b6c3-5d3b5fec3c10 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:43.137436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-cf6b1214-6af0-453e-b6c3-5d3b5fec3c10 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Going to try to start instance {{(pid=120834) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 17 07:29:43.194135 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-cf6b1214-6af0-453e-b6c3-5d3b5fec3c10 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "POST /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22/action" status: 202 len: 0 microversion: 2.1 time: 0.090552 Aug 17 07:29:43.195467 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 190/378] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 17 07:29:43 2022] POST /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:29:43.204184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3c07d2c5-54fd-4fdc-b3e8-99285dee3c98 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:43.204898 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-3c07d2c5-54fd-4fdc-b3e8-99285dee3c98 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:43.219163 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3c07d2c5-54fd-4fdc-b3e8-99285dee3c98 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:43.222694 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3c07d2c5-54fd-4fdc-b3e8-99285dee3c98 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:43.223494 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3c07d2c5-54fd-4fdc-b3e8-99285dee3c98 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:43.224463 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3c07d2c5-54fd-4fdc-b3e8-99285dee3c98 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:43.225149 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3c07d2c5-54fd-4fdc-b3e8-99285dee3c98 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:43.225904 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3c07d2c5-54fd-4fdc-b3e8-99285dee3c98 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:43.445682 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3c07d2c5-54fd-4fdc-b3e8-99285dee3c98 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:43.462554 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-3c07d2c5-54fd-4fdc-b3e8-99285dee3c98 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1710 microversion: 2.1 time: 0.262759 Aug 17 07:29:43.466321 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 189/379] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:43 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1710 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:44.049628 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-e3fb1a4f-1adb-4f48-9649-85a4f35593a1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:44.050586 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-e3fb1a4f-1adb-4f48-9649-85a4f35593a1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:44.060488 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e3fb1a4f-1adb-4f48-9649-85a4f35593a1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:44.067689 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e3fb1a4f-1adb-4f48-9649-85a4f35593a1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:44.068248 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e3fb1a4f-1adb-4f48-9649-85a4f35593a1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:44.068993 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e3fb1a4f-1adb-4f48-9649-85a4f35593a1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:44.069464 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e3fb1a4f-1adb-4f48-9649-85a4f35593a1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:44.070031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e3fb1a4f-1adb-4f48-9649-85a4f35593a1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:44.233941 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-e3fb1a4f-1adb-4f48-9649-85a4f35593a1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:44.243668 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-e3fb1a4f-1adb-4f48-9649-85a4f35593a1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:44.245410 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-e3fb1a4f-1adb-4f48-9649-85a4f35593a1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:44.246837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-e3fb1a4f-1adb-4f48-9649-85a4f35593a1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.202377 Aug 17 07:29:44.248145 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 191/380] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:44 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:44.407872 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-671422d4-9343-4461-b8fa-51e875eae596 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Action: 'create', calling method: .version_select at 0x7f30ac44d670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-83067864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPM3gaRcDYqIALuhQPRRJZWalp4Qizu9ohASItuDZvRN+685fopANjzodpNYSEW+RoocsApEUfPTC1lZF5Q6AN/RKtpJJwGVikGsfyhD1YDO8wkaVvoiA015CUbsEl954Q=="}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:44.423679 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-671422d4-9343-4461-b8fa-51e875eae596 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Getting quotas for project 5192a78d86bc40ae96a3cbb283992463. Resources: {'key_pairs'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:29:44.427539 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-671422d4-9343-4461-b8fa-51e875eae596 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Getting quotas for user 2aa5f23fe0ea4030b3858f3e5ccde8c1 and project 5192a78d86bc40ae96a3cbb283992463. Resources: {'key_pairs'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:29:44.452421 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-671422d4-9343-4461-b8fa-51e875eae596 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.048958 Aug 17 07:29:44.453057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 190/381] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 17 07:29:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:29:44.483302 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-efb393b6-4eed-42b0-83e2-b8f3585376a0 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:44.483900 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-efb393b6-4eed-42b0-83e2-b8f3585376a0 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:44.490534 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-efb393b6-4eed-42b0-83e2-b8f3585376a0 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:44.491036 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-efb393b6-4eed-42b0-83e2-b8f3585376a0 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:44.491459 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-efb393b6-4eed-42b0-83e2-b8f3585376a0 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:44.492597 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-efb393b6-4eed-42b0-83e2-b8f3585376a0 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:44.493050 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-efb393b6-4eed-42b0-83e2-b8f3585376a0 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:44.493535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-efb393b6-4eed-42b0-83e2-b8f3585376a0 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:44.566560 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3b635d19-347f-444b-a71e-52ac8b9a92af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1774994045", "imageRef": "611a5d56-96aa-4fd5-9a6e-1b103fb0268c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-83067864", "networks": [{"uuid": "17cb9bbd-e43e-4d27-810f-1301b4636e64"}]}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:44.618954 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.network.neutron [None req-3b635d19-347f-444b-a71e-52ac8b9a92af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] validate_networks() for [('17cb9bbd-e43e-4d27-810f-1301b4636e64', None, None, None, None, None)] {{(pid=120835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:29:44.626631 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-efb393b6-4eed-42b0-83e2-b8f3585376a0 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:44.634646 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-efb393b6-4eed-42b0-83e2-b8f3585376a0 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1710 microversion: 2.1 time: 0.155148 Aug 17 07:29:44.635311 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 192/382] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:44 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:44.981518 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-3b635d19-347f-444b-a71e-52ac8b9a92af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Flavor limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:29:44.982548 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-3b635d19-347f-444b-a71e-52ac8b9a92af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Image limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:29:44.983012 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-3b635d19-347f-444b-a71e-52ac8b9a92af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Flavor pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:29:44.983421 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-3b635d19-347f-444b-a71e-52ac8b9a92af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Image pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:29:44.983840 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-3b635d19-347f-444b-a71e-52ac8b9a92af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:29:44.992710 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3b635d19-347f-444b-a71e-52ac8b9a92af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:44.993176 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3b635d19-347f-444b-a71e-52ac8b9a92af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:44.993610 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3b635d19-347f-444b-a71e-52ac8b9a92af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:44.994348 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3b635d19-347f-444b-a71e-52ac8b9a92af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:44.994792 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3b635d19-347f-444b-a71e-52ac8b9a92af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:44.995206 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3b635d19-347f-444b-a71e-52ac8b9a92af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:45.011104 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-3b635d19-347f-444b-a71e-52ac8b9a92af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Getting quotas for project 5192a78d86bc40ae96a3cbb283992463. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:29:45.015114 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-3b635d19-347f-444b-a71e-52ac8b9a92af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Getting quotas for user 2aa5f23fe0ea4030b3858f3e5ccde8c1 and project 5192a78d86bc40ae96a3cbb283992463. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:29:45.027483 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-3b635d19-347f-444b-a71e-52ac8b9a92af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Going to run 1 instances... {{(pid=120835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:29:45.030395 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-3b635d19-347f-444b-a71e-52ac8b9a92af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611a5d56-96aa-4fd5-9a6e-1b103fb0268c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:29:45.072862 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-3b635d19-347f-444b-a71e-52ac8b9a92af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510127 Aug 17 07:29:45.073504 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 191/383] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:29:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 07:29:45.083944 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a664313b-d310-4472-a5a7-62dc24c27135 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:45.084547 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-a664313b-d310-4472-a5a7-62dc24c27135 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:45.141218 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a664313b-d310-4472-a5a7-62dc24c27135 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:45.148585 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a664313b-d310-4472-a5a7-62dc24c27135 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1257 microversion: 2.1 time: 0.068372 Aug 17 07:29:45.149363 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 193/384] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:45 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:45.270094 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2d65c03e-ee72-4174-afc1-69261f1a93bb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:45.270808 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-2d65c03e-ee72-4174-afc1-69261f1a93bb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:45.278092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2d65c03e-ee72-4174-afc1-69261f1a93bb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:45.278577 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2d65c03e-ee72-4174-afc1-69261f1a93bb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:45.279807 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2d65c03e-ee72-4174-afc1-69261f1a93bb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:45.281126 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2d65c03e-ee72-4174-afc1-69261f1a93bb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:45.281781 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2d65c03e-ee72-4174-afc1-69261f1a93bb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:45.282226 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2d65c03e-ee72-4174-afc1-69261f1a93bb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:45.422740 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2d65c03e-ee72-4174-afc1-69261f1a93bb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:45.432166 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2d65c03e-ee72-4174-afc1-69261f1a93bb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:45.433732 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2d65c03e-ee72-4174-afc1-69261f1a93bb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:45.434961 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-2d65c03e-ee72-4174-afc1-69261f1a93bb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.168777 Aug 17 07:29:45.435515 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 192/385] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:45 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:45.655976 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-aa369647-c851-4c6e-a23b-b9cbd62baf35 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:45.656659 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-aa369647-c851-4c6e-a23b-b9cbd62baf35 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:45.664700 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aa369647-c851-4c6e-a23b-b9cbd62baf35 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:45.665194 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aa369647-c851-4c6e-a23b-b9cbd62baf35 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:45.665789 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aa369647-c851-4c6e-a23b-b9cbd62baf35 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:45.667289 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aa369647-c851-4c6e-a23b-b9cbd62baf35 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:45.667751 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aa369647-c851-4c6e-a23b-b9cbd62baf35 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:45.668345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aa369647-c851-4c6e-a23b-b9cbd62baf35 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:45.807152 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-aa369647-c851-4c6e-a23b-b9cbd62baf35 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:45.816472 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-aa369647-c851-4c6e-a23b-b9cbd62baf35 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1714 microversion: 2.1 time: 0.164516 Aug 17 07:29:45.817332 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 194/386] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:45 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1714 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:46.170705 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-57781bba-910a-40df-abf3-11ef1aacb9f0 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:46.171406 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-57781bba-910a-40df-abf3-11ef1aacb9f0 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:46.177989 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57781bba-910a-40df-abf3-11ef1aacb9f0 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:46.178815 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57781bba-910a-40df-abf3-11ef1aacb9f0 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:46.179338 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57781bba-910a-40df-abf3-11ef1aacb9f0 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:46.180117 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57781bba-910a-40df-abf3-11ef1aacb9f0 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:46.180584 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57781bba-910a-40df-abf3-11ef1aacb9f0 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:46.181036 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57781bba-910a-40df-abf3-11ef1aacb9f0 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:46.302526 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-57781bba-910a-40df-abf3-11ef1aacb9f0 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:46.310667 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-57781bba-910a-40df-abf3-11ef1aacb9f0 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1309 microversion: 2.1 time: 0.145375 Aug 17 07:29:46.311939 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 193/387] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:46 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1309 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:46.457890 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-250372fb-1018-4d85-8e74-5393d1289829 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:46.458666 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-250372fb-1018-4d85-8e74-5393d1289829 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:46.465257 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-250372fb-1018-4d85-8e74-5393d1289829 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:46.465837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-250372fb-1018-4d85-8e74-5393d1289829 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:46.467037 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-250372fb-1018-4d85-8e74-5393d1289829 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:46.467756 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-250372fb-1018-4d85-8e74-5393d1289829 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:46.468360 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-250372fb-1018-4d85-8e74-5393d1289829 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:46.468904 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-250372fb-1018-4d85-8e74-5393d1289829 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:46.612857 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-250372fb-1018-4d85-8e74-5393d1289829 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:46.621648 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-250372fb-1018-4d85-8e74-5393d1289829 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:46.623261 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-250372fb-1018-4d85-8e74-5393d1289829 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:46.624414 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-250372fb-1018-4d85-8e74-5393d1289829 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.170511 Aug 17 07:29:46.624967 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 195/388] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:46 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:47.331897 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-12731b93-957c-452b-ba01-1f5693decd8e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:47.332507 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-12731b93-957c-452b-ba01-1f5693decd8e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:47.339127 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-12731b93-957c-452b-ba01-1f5693decd8e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:47.339838 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-12731b93-957c-452b-ba01-1f5693decd8e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:47.340280 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-12731b93-957c-452b-ba01-1f5693decd8e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:47.340984 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-12731b93-957c-452b-ba01-1f5693decd8e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:47.341438 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-12731b93-957c-452b-ba01-1f5693decd8e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:47.341859 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-12731b93-957c-452b-ba01-1f5693decd8e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:47.419598 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-12731b93-957c-452b-ba01-1f5693decd8e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:47.427721 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-12731b93-957c-452b-ba01-1f5693decd8e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1309 microversion: 2.1 time: 0.099638 Aug 17 07:29:47.428981 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 194/389] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:47 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:47.651324 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-aeaf6987-86b7-40e2-bd63-42a5ffc615a7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:47.652435 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-aeaf6987-86b7-40e2-bd63-42a5ffc615a7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:47.659736 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aeaf6987-86b7-40e2-bd63-42a5ffc615a7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:47.660203 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aeaf6987-86b7-40e2-bd63-42a5ffc615a7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:47.660631 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aeaf6987-86b7-40e2-bd63-42a5ffc615a7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:47.661320 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aeaf6987-86b7-40e2-bd63-42a5ffc615a7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:47.661764 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aeaf6987-86b7-40e2-bd63-42a5ffc615a7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:47.662209 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aeaf6987-86b7-40e2-bd63-42a5ffc615a7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:47.798544 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-aeaf6987-86b7-40e2-bd63-42a5ffc615a7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:47.806974 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-aeaf6987-86b7-40e2-bd63-42a5ffc615a7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:47.808465 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-aeaf6987-86b7-40e2-bd63-42a5ffc615a7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:47.809596 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-aeaf6987-86b7-40e2-bd63-42a5ffc615a7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.164892 Aug 17 07:29:47.810217 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 196/390] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:47 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:48.448500 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-903aa7e0-59e1-4a2c-b0b9-083067915d2d tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:48.449168 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-903aa7e0-59e1-4a2c-b0b9-083067915d2d tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:48.457294 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-903aa7e0-59e1-4a2c-b0b9-083067915d2d tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:48.457776 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-903aa7e0-59e1-4a2c-b0b9-083067915d2d tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:48.458246 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-903aa7e0-59e1-4a2c-b0b9-083067915d2d tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:48.459016 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-903aa7e0-59e1-4a2c-b0b9-083067915d2d tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:48.459718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-903aa7e0-59e1-4a2c-b0b9-083067915d2d tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:48.460320 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-903aa7e0-59e1-4a2c-b0b9-083067915d2d tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:48.477402 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:48.527954 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-903aa7e0-59e1-4a2c-b0b9-083067915d2d tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:48.536691 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-903aa7e0-59e1-4a2c-b0b9-083067915d2d tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1309 microversion: 2.1 time: 0.091782 Aug 17 07:29:48.537920 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 195/391] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:48 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:48.833497 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-cafa5899-e7ac-4cb0-accb-cccb2d7c8ad1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:48.834765 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-cafa5899-e7ac-4cb0-accb-cccb2d7c8ad1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:48.841403 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cafa5899-e7ac-4cb0-accb-cccb2d7c8ad1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:48.841896 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cafa5899-e7ac-4cb0-accb-cccb2d7c8ad1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:48.842436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cafa5899-e7ac-4cb0-accb-cccb2d7c8ad1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:48.843149 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cafa5899-e7ac-4cb0-accb-cccb2d7c8ad1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:48.843602 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cafa5899-e7ac-4cb0-accb-cccb2d7c8ad1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:48.844030 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cafa5899-e7ac-4cb0-accb-cccb2d7c8ad1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:48.847584 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:48.983439 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-cafa5899-e7ac-4cb0-accb-cccb2d7c8ad1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:48.991839 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-cafa5899-e7ac-4cb0-accb-cccb2d7c8ad1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:48.993587 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-cafa5899-e7ac-4cb0-accb-cccb2d7c8ad1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:48.994766 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-cafa5899-e7ac-4cb0-accb-cccb2d7c8ad1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.165779 Aug 17 07:29:48.995315 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 197/392] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:48 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:49.556739 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-4de43cea-45b9-4778-be9a-f332e5243b7c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:49.557471 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-4de43cea-45b9-4778-be9a-f332e5243b7c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:49.564067 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4de43cea-45b9-4778-be9a-f332e5243b7c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:49.564551 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4de43cea-45b9-4778-be9a-f332e5243b7c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:49.564990 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4de43cea-45b9-4778-be9a-f332e5243b7c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:49.565686 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4de43cea-45b9-4778-be9a-f332e5243b7c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:49.566181 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4de43cea-45b9-4778-be9a-f332e5243b7c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:49.566613 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4de43cea-45b9-4778-be9a-f332e5243b7c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:49.638374 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-4de43cea-45b9-4778-be9a-f332e5243b7c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:49.646162 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-4de43cea-45b9-4778-be9a-f332e5243b7c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1309 microversion: 2.1 time: 0.093329 Aug 17 07:29:49.646741 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 196/393] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:49 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:50.018993 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0038077c-ffe7-4d3c-967e-1450abee1804 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:50.019592 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0038077c-ffe7-4d3c-967e-1450abee1804 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:50.025935 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0038077c-ffe7-4d3c-967e-1450abee1804 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:50.026441 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0038077c-ffe7-4d3c-967e-1450abee1804 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:50.026900 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0038077c-ffe7-4d3c-967e-1450abee1804 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:50.027621 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0038077c-ffe7-4d3c-967e-1450abee1804 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:50.028069 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0038077c-ffe7-4d3c-967e-1450abee1804 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:50.028995 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0038077c-ffe7-4d3c-967e-1450abee1804 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:50.174500 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0038077c-ffe7-4d3c-967e-1450abee1804 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:50.183187 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0038077c-ffe7-4d3c-967e-1450abee1804 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:50.184743 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0038077c-ffe7-4d3c-967e-1450abee1804 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:50.185894 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0038077c-ffe7-4d3c-967e-1450abee1804 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.170798 Aug 17 07:29:50.186478 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 198/394] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:50 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:50.667238 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-beb23343-2709-4c0a-bf6b-0d942c0a4bc1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:50.667782 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-beb23343-2709-4c0a-bf6b-0d942c0a4bc1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:50.674221 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-beb23343-2709-4c0a-bf6b-0d942c0a4bc1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:50.674699 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-beb23343-2709-4c0a-bf6b-0d942c0a4bc1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:50.675132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-beb23343-2709-4c0a-bf6b-0d942c0a4bc1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:50.675821 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-beb23343-2709-4c0a-bf6b-0d942c0a4bc1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:50.676269 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-beb23343-2709-4c0a-bf6b-0d942c0a4bc1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:50.676692 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-beb23343-2709-4c0a-bf6b-0d942c0a4bc1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:50.743351 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-beb23343-2709-4c0a-bf6b-0d942c0a4bc1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:50.751303 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-beb23343-2709-4c0a-bf6b-0d942c0a4bc1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1309 microversion: 2.1 time: 0.088072 Aug 17 07:29:50.751965 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 197/395] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:50 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1309 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:51.210017 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-580a785a-0989-45e6-897c-9156cc06186a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:51.210017 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-580a785a-0989-45e6-897c-9156cc06186a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:51.214779 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=84 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:51.216749 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-580a785a-0989-45e6-897c-9156cc06186a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:51.217428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-580a785a-0989-45e6-897c-9156cc06186a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:51.218211 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-580a785a-0989-45e6-897c-9156cc06186a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:51.219134 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-580a785a-0989-45e6-897c-9156cc06186a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:51.219779 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-580a785a-0989-45e6-897c-9156cc06186a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:51.220406 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-580a785a-0989-45e6-897c-9156cc06186a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:51.356960 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-580a785a-0989-45e6-897c-9156cc06186a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:51.365882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-580a785a-0989-45e6-897c-9156cc06186a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:51.367674 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-580a785a-0989-45e6-897c-9156cc06186a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:51.368829 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-580a785a-0989-45e6-897c-9156cc06186a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.164397 Aug 17 07:29:51.369393 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 199/396] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:51 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:51.772614 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-05568dd0-58e5-492e-8e45-d4f99adddffe tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:51.773224 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-05568dd0-58e5-492e-8e45-d4f99adddffe tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:51.779635 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-05568dd0-58e5-492e-8e45-d4f99adddffe tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:51.780108 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-05568dd0-58e5-492e-8e45-d4f99adddffe tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:51.780536 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-05568dd0-58e5-492e-8e45-d4f99adddffe tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:51.781727 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-05568dd0-58e5-492e-8e45-d4f99adddffe tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:51.782200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-05568dd0-58e5-492e-8e45-d4f99adddffe tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:51.782620 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-05568dd0-58e5-492e-8e45-d4f99adddffe tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:51.842635 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-05568dd0-58e5-492e-8e45-d4f99adddffe tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:51.850636 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-05568dd0-58e5-492e-8e45-d4f99adddffe tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1309 microversion: 2.1 time: 0.081907 Aug 17 07:29:51.851206 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 198/397] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:51 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1309 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:52.392161 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-82982a8f-d1c6-4a73-abee-dca44a04f28c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:52.392811 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-82982a8f-d1c6-4a73-abee-dca44a04f28c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:52.399575 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-82982a8f-d1c6-4a73-abee-dca44a04f28c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:52.400057 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-82982a8f-d1c6-4a73-abee-dca44a04f28c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:52.400495 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-82982a8f-d1c6-4a73-abee-dca44a04f28c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:52.401635 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-82982a8f-d1c6-4a73-abee-dca44a04f28c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:52.401635 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-82982a8f-d1c6-4a73-abee-dca44a04f28c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:52.402072 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-82982a8f-d1c6-4a73-abee-dca44a04f28c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:52.534260 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-82982a8f-d1c6-4a73-abee-dca44a04f28c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:52.543095 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-82982a8f-d1c6-4a73-abee-dca44a04f28c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:52.545450 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-82982a8f-d1c6-4a73-abee-dca44a04f28c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:52.547226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-82982a8f-d1c6-4a73-abee-dca44a04f28c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.159615 Aug 17 07:29:52.548160 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 200/398] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:52 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:52.872509 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-1310a8a6-c4ec-46f4-b2fe-f728b0576656 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:52.873328 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-1310a8a6-c4ec-46f4-b2fe-f728b0576656 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:52.880754 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1310a8a6-c4ec-46f4-b2fe-f728b0576656 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:52.881380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1310a8a6-c4ec-46f4-b2fe-f728b0576656 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:52.881920 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1310a8a6-c4ec-46f4-b2fe-f728b0576656 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:52.882754 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1310a8a6-c4ec-46f4-b2fe-f728b0576656 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:52.883329 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1310a8a6-c4ec-46f4-b2fe-f728b0576656 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:52.883866 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1310a8a6-c4ec-46f4-b2fe-f728b0576656 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:52.950632 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-1310a8a6-c4ec-46f4-b2fe-f728b0576656 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:52.958589 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-1310a8a6-c4ec-46f4-b2fe-f728b0576656 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1309 microversion: 2.1 time: 0.090394 Aug 17 07:29:52.959164 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 199/399] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:52 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:53.571059 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7fc712be-5b19-41df-a311-33306d8044be tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:53.571675 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-7fc712be-5b19-41df-a311-33306d8044be tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:53.578348 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7fc712be-5b19-41df-a311-33306d8044be tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:53.578851 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7fc712be-5b19-41df-a311-33306d8044be tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:53.579288 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7fc712be-5b19-41df-a311-33306d8044be tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:53.580533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7fc712be-5b19-41df-a311-33306d8044be tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:53.580987 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7fc712be-5b19-41df-a311-33306d8044be tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:53.581413 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7fc712be-5b19-41df-a311-33306d8044be tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:53.726375 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-7fc712be-5b19-41df-a311-33306d8044be tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:53.735386 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-7fc712be-5b19-41df-a311-33306d8044be tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:53.736893 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-7fc712be-5b19-41df-a311-33306d8044be tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:53.738063 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-7fc712be-5b19-41df-a311-33306d8044be tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.170987 Aug 17 07:29:53.738624 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 201/400] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:53 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:53.979816 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e3d20d43-522c-4728-9bd0-5f49f8ff2683 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:53.980431 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e3d20d43-522c-4728-9bd0-5f49f8ff2683 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:53.987128 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e3d20d43-522c-4728-9bd0-5f49f8ff2683 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:53.987547 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e3d20d43-522c-4728-9bd0-5f49f8ff2683 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:53.988028 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e3d20d43-522c-4728-9bd0-5f49f8ff2683 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:53.988677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e3d20d43-522c-4728-9bd0-5f49f8ff2683 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:53.989140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e3d20d43-522c-4728-9bd0-5f49f8ff2683 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:53.989567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e3d20d43-522c-4728-9bd0-5f49f8ff2683 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:54.054652 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-e3d20d43-522c-4728-9bd0-5f49f8ff2683 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:54.062180 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e3d20d43-522c-4728-9bd0-5f49f8ff2683 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1309 microversion: 2.1 time: 0.086164 Aug 17 07:29:54.062764 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 200/401] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:53 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1309 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:54.471416 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9ec0d0df-299e-4139-9c2d-bdd0db45b5ee tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9254b136-155d-4ea8-b1a1-399209c81656"}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:54.473815 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9ec0d0df-299e-4139-9c2d-bdd0db45b5ee tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:54.480305 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ec0d0df-299e-4139-9c2d-bdd0db45b5ee tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:54.483065 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ec0d0df-299e-4139-9c2d-bdd0db45b5ee tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:54.483602 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ec0d0df-299e-4139-9c2d-bdd0db45b5ee tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:54.484277 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ec0d0df-299e-4139-9c2d-bdd0db45b5ee tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:54.484743 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ec0d0df-299e-4139-9c2d-bdd0db45b5ee tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:54.485172 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ec0d0df-299e-4139-9c2d-bdd0db45b5ee tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:54.760811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-166dc107-fbed-4b71-9e78-c3778ee6ef2b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:54.761758 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-166dc107-fbed-4b71-9e78-c3778ee6ef2b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:54.775654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-166dc107-fbed-4b71-9e78-c3778ee6ef2b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:54.776077 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-166dc107-fbed-4b71-9e78-c3778ee6ef2b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:54.776518 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-166dc107-fbed-4b71-9e78-c3778ee6ef2b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:54.777242 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-166dc107-fbed-4b71-9e78-c3778ee6ef2b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:54.777695 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-166dc107-fbed-4b71-9e78-c3778ee6ef2b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:54.778149 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-166dc107-fbed-4b71-9e78-c3778ee6ef2b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:54.918130 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-166dc107-fbed-4b71-9e78-c3778ee6ef2b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:54.927184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-166dc107-fbed-4b71-9e78-c3778ee6ef2b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:54.929125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-166dc107-fbed-4b71-9e78-c3778ee6ef2b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:54.930325 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-166dc107-fbed-4b71-9e78-c3778ee6ef2b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.173428 Aug 17 07:29:54.930878 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 201/402] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:54 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:29:55.084217 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-4401a2b0-2a47-4266-8409-06fddc55648a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:55.084879 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-4401a2b0-2a47-4266-8409-06fddc55648a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:55.087132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=2 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:55.088299 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=10 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:55.092067 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:55.094677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4401a2b0-2a47-4266-8409-06fddc55648a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:55.095819 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4401a2b0-2a47-4266-8409-06fddc55648a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:55.096261 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4401a2b0-2a47-4266-8409-06fddc55648a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:55.096965 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4401a2b0-2a47-4266-8409-06fddc55648a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:55.097448 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4401a2b0-2a47-4266-8409-06fddc55648a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:55.097877 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4401a2b0-2a47-4266-8409-06fddc55648a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:55.145369 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=2 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:55.161830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-4401a2b0-2a47-4266-8409-06fddc55648a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:55.169284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-4401a2b0-2a47-4266-8409-06fddc55648a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1309 microversion: 2.1 time: 0.089501 Aug 17 07:29:55.169831 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 202/403] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:55 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:29:55.952909 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c36157cc-0235-404a-b70d-e5885bf45464 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:55.953695 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-c36157cc-0235-404a-b70d-e5885bf45464 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:55.960077 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c36157cc-0235-404a-b70d-e5885bf45464 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:55.960640 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c36157cc-0235-404a-b70d-e5885bf45464 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:55.961159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c36157cc-0235-404a-b70d-e5885bf45464 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:55.961921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c36157cc-0235-404a-b70d-e5885bf45464 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:55.962467 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c36157cc-0235-404a-b70d-e5885bf45464 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:55.962960 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c36157cc-0235-404a-b70d-e5885bf45464 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:56.098892 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c36157cc-0235-404a-b70d-e5885bf45464 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:56.107763 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c36157cc-0235-404a-b70d-e5885bf45464 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:56.109365 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c36157cc-0235-404a-b70d-e5885bf45464 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:56.110653 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-c36157cc-0235-404a-b70d-e5885bf45464 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.161939 Aug 17 07:29:56.111857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 203/404] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:55 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:29:56.189854 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d3fdf935-c36b-478e-81f7-d9bf28fb081e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:56.190505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d3fdf935-c36b-478e-81f7-d9bf28fb081e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:56.196905 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d3fdf935-c36b-478e-81f7-d9bf28fb081e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:56.197466 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d3fdf935-c36b-478e-81f7-d9bf28fb081e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:56.197940 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d3fdf935-c36b-478e-81f7-d9bf28fb081e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:56.198680 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d3fdf935-c36b-478e-81f7-d9bf28fb081e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:56.199251 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d3fdf935-c36b-478e-81f7-d9bf28fb081e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:56.199728 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d3fdf935-c36b-478e-81f7-d9bf28fb081e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:56.267941 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d3fdf935-c36b-478e-81f7-d9bf28fb081e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:56.275298 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d3fdf935-c36b-478e-81f7-d9bf28fb081e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1309 microversion: 2.1 time: 0.089323 Aug 17 07:29:56.275856 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 204/405] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:56 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1309 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:29:56.997472 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9ec0d0df-299e-4139-9c2d-bdd0db45b5ee tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "POST /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.530322 Aug 17 07:29:56.998107 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 202/406] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 17 07:29:54 2022] POST /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/os-volume_attachments => generated 194 bytes in 2532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:29:57.133456 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-83e69023-9e65-41ff-816b-768801e1b48f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:57.134092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-83e69023-9e65-41ff-816b-768801e1b48f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:57.140518 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-83e69023-9e65-41ff-816b-768801e1b48f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:57.140939 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-83e69023-9e65-41ff-816b-768801e1b48f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:57.141378 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-83e69023-9e65-41ff-816b-768801e1b48f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:57.142101 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-83e69023-9e65-41ff-816b-768801e1b48f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:57.142556 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-83e69023-9e65-41ff-816b-768801e1b48f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:57.142981 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-83e69023-9e65-41ff-816b-768801e1b48f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:57.281639 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-83e69023-9e65-41ff-816b-768801e1b48f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:57.290348 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-83e69023-9e65-41ff-816b-768801e1b48f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:57.291873 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-83e69023-9e65-41ff-816b-768801e1b48f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:57.293049 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-83e69023-9e65-41ff-816b-768801e1b48f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.163508 Aug 17 07:29:57.293782 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 205/407] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:57 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:57.303717 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0e8edf40-c2c6-4c2b-a242-cbb760939b90 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:57.304427 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0e8edf40-c2c6-4c2b-a242-cbb760939b90 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:57.310885 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0e8edf40-c2c6-4c2b-a242-cbb760939b90 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:57.311368 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0e8edf40-c2c6-4c2b-a242-cbb760939b90 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:57.311808 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0e8edf40-c2c6-4c2b-a242-cbb760939b90 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:57.312506 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0e8edf40-c2c6-4c2b-a242-cbb760939b90 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:57.312963 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0e8edf40-c2c6-4c2b-a242-cbb760939b90 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:57.313390 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0e8edf40-c2c6-4c2b-a242-cbb760939b90 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:57.378558 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0e8edf40-c2c6-4c2b-a242-cbb760939b90 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:57.386221 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0e8edf40-c2c6-4c2b-a242-cbb760939b90 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1315 microversion: 2.1 time: 0.093236 Aug 17 07:29:57.386773 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 203/408] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:57 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1315 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:29:58.316831 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-530929a2-ca8d-4395-885c-f3a46342eb0c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:58.318104 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-530929a2-ca8d-4395-885c-f3a46342eb0c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:58.325093 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-530929a2-ca8d-4395-885c-f3a46342eb0c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:58.325576 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-530929a2-ca8d-4395-885c-f3a46342eb0c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:58.334726 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-530929a2-ca8d-4395-885c-f3a46342eb0c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:58.335629 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-530929a2-ca8d-4395-885c-f3a46342eb0c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:58.336173 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-530929a2-ca8d-4395-885c-f3a46342eb0c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:58.336612 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-530929a2-ca8d-4395-885c-f3a46342eb0c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:58.407921 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-53104164-02e0-4eeb-bcf9-7cba048dd459 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:58.409268 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-53104164-02e0-4eeb-bcf9-7cba048dd459 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:58.420434 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-53104164-02e0-4eeb-bcf9-7cba048dd459 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:58.429225 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-53104164-02e0-4eeb-bcf9-7cba048dd459 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:58.430028 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-53104164-02e0-4eeb-bcf9-7cba048dd459 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:58.431266 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-53104164-02e0-4eeb-bcf9-7cba048dd459 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:58.432024 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-53104164-02e0-4eeb-bcf9-7cba048dd459 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:58.432671 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-53104164-02e0-4eeb-bcf9-7cba048dd459 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:58.734516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-530929a2-ca8d-4395-885c-f3a46342eb0c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:58.738154 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-53104164-02e0-4eeb-bcf9-7cba048dd459 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:58.747315 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-530929a2-ca8d-4395-885c-f3a46342eb0c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:58.748839 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-530929a2-ca8d-4395-885c-f3a46342eb0c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:58.749213 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-53104164-02e0-4eeb-bcf9-7cba048dd459 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1357 microversion: 2.1 time: 0.343885 Aug 17 07:29:58.750737 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 204/409] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:58 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1357 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:29:58.752102 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-530929a2-ca8d-4395-885c-f3a46342eb0c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.437120 Aug 17 07:29:58.758434 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 206/410] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:58 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:29:59.065848 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-7a3b9937-6ac4-4380-8c07-6dbba5c887a1 req-ad4ab633-3267-4996-badd-7990046bae81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a37385c-cdcc-4d52-89c4-241744d2d17d", "tag": "fb3fc6d2-2e3d-4fa5-979a-023f68ad390f"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:29:59.076630 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-7a3b9937-6ac4-4380-8c07-6dbba5c887a1 req-ad4ab633-3267-4996-badd-7990046bae81 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:59.077370 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-7a3b9937-6ac4-4380-8c07-6dbba5c887a1 req-ad4ab633-3267-4996-badd-7990046bae81 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:59.077985 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-7a3b9937-6ac4-4380-8c07-6dbba5c887a1 req-ad4ab633-3267-4996-badd-7990046bae81 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:59.090285 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-7a3b9937-6ac4-4380-8c07-6dbba5c887a1 req-ad4ab633-3267-4996-badd-7990046bae81 service nova] Creating event network-changed:fb3fc6d2-2e3d-4fa5-979a-023f68ad390f for instance 4a37385c-cdcc-4d52-89c4-241744d2d17d on hv-cinder-85312 Aug 17 07:29:59.095047 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-7a3b9937-6ac4-4380-8c07-6dbba5c887a1 req-ad4ab633-3267-4996-badd-7990046bae81 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033408 Aug 17 07:29:59.095854 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 205/411] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:29:59.775074 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-94f9f3fc-8bc2-42d3-8098-8d4ee07809c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:59.776097 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-94f9f3fc-8bc2-42d3-8098-8d4ee07809c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:59.781760 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b8fca239-5986-4e6e-80bc-f3a282832508 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:29:59.783120 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-b8fca239-5986-4e6e-80bc-f3a282832508 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:29:59.783425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-94f9f3fc-8bc2-42d3-8098-8d4ee07809c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:59.783911 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-94f9f3fc-8bc2-42d3-8098-8d4ee07809c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:59.784532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-94f9f3fc-8bc2-42d3-8098-8d4ee07809c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:59.785403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-94f9f3fc-8bc2-42d3-8098-8d4ee07809c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:59.786052 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-94f9f3fc-8bc2-42d3-8098-8d4ee07809c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:59.786649 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-94f9f3fc-8bc2-42d3-8098-8d4ee07809c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:59.790176 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b8fca239-5986-4e6e-80bc-f3a282832508 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:59.790765 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b8fca239-5986-4e6e-80bc-f3a282832508 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:59.791298 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b8fca239-5986-4e6e-80bc-f3a282832508 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:59.792102 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b8fca239-5986-4e6e-80bc-f3a282832508 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:29:59.792775 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b8fca239-5986-4e6e-80bc-f3a282832508 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:29:59.793426 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b8fca239-5986-4e6e-80bc-f3a282832508 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:29:59.991822 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-94f9f3fc-8bc2-42d3-8098-8d4ee07809c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:59.996080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-b8fca239-5986-4e6e-80bc-f3a282832508 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:29:59.999717 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-94f9f3fc-8bc2-42d3-8098-8d4ee07809c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1357 microversion: 2.1 time: 0.229445 Aug 17 07:30:00.000542 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 207/412] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:29:59 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:00.004865 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-b8fca239-5986-4e6e-80bc-f3a282832508 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:00.006391 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-b8fca239-5986-4e6e-80bc-f3a282832508 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:00.007550 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b8fca239-5986-4e6e-80bc-f3a282832508 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.230444 Aug 17 07:30:00.008211 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 206/413] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:29:59 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:30:01.020385 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-63a71d77-ce8c-435a-ba19-a1664d5824ba tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:01.021135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-63a71d77-ce8c-435a-ba19-a1664d5824ba tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:01.028300 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-63a71d77-ce8c-435a-ba19-a1664d5824ba tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:01.028871 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-63a71d77-ce8c-435a-ba19-a1664d5824ba tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:01.029505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-63a71d77-ce8c-435a-ba19-a1664d5824ba tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:01.030410 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-63a71d77-ce8c-435a-ba19-a1664d5824ba tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:01.030861 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-63a71d77-ce8c-435a-ba19-a1664d5824ba tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:01.031210 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-33cef81b-b064-4063-a89e-738630c593b4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:01.031663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-63a71d77-ce8c-435a-ba19-a1664d5824ba tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:01.032128 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-33cef81b-b064-4063-a89e-738630c593b4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:01.038818 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-33cef81b-b064-4063-a89e-738630c593b4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:01.039285 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-33cef81b-b064-4063-a89e-738630c593b4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:01.039711 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-33cef81b-b064-4063-a89e-738630c593b4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:01.040411 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-33cef81b-b064-4063-a89e-738630c593b4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:01.040855 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-33cef81b-b064-4063-a89e-738630c593b4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:01.041276 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-33cef81b-b064-4063-a89e-738630c593b4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:01.467373 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-33cef81b-b064-4063-a89e-738630c593b4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:01.469174 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-63a71d77-ce8c-435a-ba19-a1664d5824ba tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:01.477722 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-33cef81b-b064-4063-a89e-738630c593b4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:01.479286 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-33cef81b-b064-4063-a89e-738630c593b4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:01.480454 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-33cef81b-b064-4063-a89e-738630c593b4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.454386 Aug 17 07:30:01.482067 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 207/414] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:30:01 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:30:01.486876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-63a71d77-ce8c-435a-ba19-a1664d5824ba tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1357 microversion: 2.1 time: 0.470339 Aug 17 07:30:01.487457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 208/415] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:01 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1357 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:02.508008 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c1d9a245-ffe7-413c-875f-cba262469a1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:02.508566 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-77694c5b-6f5f-438c-a298-43cbe47c1812 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:02.508990 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c1d9a245-ffe7-413c-875f-cba262469a1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:02.509089 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-77694c5b-6f5f-438c-a298-43cbe47c1812 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:02.515935 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-77694c5b-6f5f-438c-a298-43cbe47c1812 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:02.516660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-77694c5b-6f5f-438c-a298-43cbe47c1812 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:02.517101 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-77694c5b-6f5f-438c-a298-43cbe47c1812 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:02.517320 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c1d9a245-ffe7-413c-875f-cba262469a1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:02.517805 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-77694c5b-6f5f-438c-a298-43cbe47c1812 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:02.517917 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c1d9a245-ffe7-413c-875f-cba262469a1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:02.518287 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-77694c5b-6f5f-438c-a298-43cbe47c1812 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:02.518394 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c1d9a245-ffe7-413c-875f-cba262469a1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:02.518714 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-77694c5b-6f5f-438c-a298-43cbe47c1812 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:02.518982 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c1d9a245-ffe7-413c-875f-cba262469a1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:02.519437 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c1d9a245-ffe7-413c-875f-cba262469a1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:02.519864 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c1d9a245-ffe7-413c-875f-cba262469a1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:02.723865 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-77694c5b-6f5f-438c-a298-43cbe47c1812 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:02.727166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c1d9a245-ffe7-413c-875f-cba262469a1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:02.731671 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-77694c5b-6f5f-438c-a298-43cbe47c1812 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1357 microversion: 2.1 time: 0.227403 Aug 17 07:30:02.732523 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 209/416] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:02 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:02.751483 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c1d9a245-ffe7-413c-875f-cba262469a1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:02.752997 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c1d9a245-ffe7-413c-875f-cba262469a1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:02.754212 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c1d9a245-ffe7-413c-875f-cba262469a1b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.250250 Aug 17 07:30:02.754775 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 208/417] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:30:02 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:30:03.755467 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-f90f969f-29e4-44c8-bb17-ff6546a2bf17 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:03.756286 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-f90f969f-29e4-44c8-bb17-ff6546a2bf17 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:03.763117 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f90f969f-29e4-44c8-bb17-ff6546a2bf17 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:03.763603 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f90f969f-29e4-44c8-bb17-ff6546a2bf17 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:03.764040 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f90f969f-29e4-44c8-bb17-ff6546a2bf17 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:03.764743 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f90f969f-29e4-44c8-bb17-ff6546a2bf17 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:03.767761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f90f969f-29e4-44c8-bb17-ff6546a2bf17 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:03.768201 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f90f969f-29e4-44c8-bb17-ff6546a2bf17 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:03.776940 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-2d60e1e9-9614-4b5a-9fff-8f145ad56bf8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:03.777771 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-2d60e1e9-9614-4b5a-9fff-8f145ad56bf8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:03.785325 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2d60e1e9-9614-4b5a-9fff-8f145ad56bf8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:03.786148 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2d60e1e9-9614-4b5a-9fff-8f145ad56bf8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:03.786588 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2d60e1e9-9614-4b5a-9fff-8f145ad56bf8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:03.787309 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2d60e1e9-9614-4b5a-9fff-8f145ad56bf8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:03.787923 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2d60e1e9-9614-4b5a-9fff-8f145ad56bf8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:03.788789 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2d60e1e9-9614-4b5a-9fff-8f145ad56bf8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:03.987452 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-f90f969f-29e4-44c8-bb17-ff6546a2bf17 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:03.996491 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-f90f969f-29e4-44c8-bb17-ff6546a2bf17 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1357 microversion: 2.1 time: 0.245803 Aug 17 07:30:03.997428 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 210/418] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:03 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1357 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:03.999442 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-2d60e1e9-9614-4b5a-9fff-8f145ad56bf8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:04.008865 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-2d60e1e9-9614-4b5a-9fff-8f145ad56bf8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:04.010358 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-2d60e1e9-9614-4b5a-9fff-8f145ad56bf8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:04.011515 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-2d60e1e9-9614-4b5a-9fff-8f145ad56bf8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.238528 Aug 17 07:30:04.012096 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 209/419] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:30:03 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:30:05.016801 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-161a218c-17f0-48d6-9829-b2c885ad5a1a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:05.017424 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-161a218c-17f0-48d6-9829-b2c885ad5a1a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:05.024324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-161a218c-17f0-48d6-9829-b2c885ad5a1a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:05.024793 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-161a218c-17f0-48d6-9829-b2c885ad5a1a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:05.025219 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-161a218c-17f0-48d6-9829-b2c885ad5a1a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:05.025903 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-161a218c-17f0-48d6-9829-b2c885ad5a1a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:05.026488 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-161a218c-17f0-48d6-9829-b2c885ad5a1a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:05.026909 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-161a218c-17f0-48d6-9829-b2c885ad5a1a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:05.034746 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c1bf8cd2-f13f-4bb3-a99d-f4d678f37a31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:05.035437 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c1bf8cd2-f13f-4bb3-a99d-f4d678f37a31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:05.042948 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c1bf8cd2-f13f-4bb3-a99d-f4d678f37a31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:05.043487 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c1bf8cd2-f13f-4bb3-a99d-f4d678f37a31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:05.043931 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c1bf8cd2-f13f-4bb3-a99d-f4d678f37a31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:05.044642 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c1bf8cd2-f13f-4bb3-a99d-f4d678f37a31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:05.045099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c1bf8cd2-f13f-4bb3-a99d-f4d678f37a31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:05.046102 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c1bf8cd2-f13f-4bb3-a99d-f4d678f37a31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:05.244271 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c1bf8cd2-f13f-4bb3-a99d-f4d678f37a31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:05.248776 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-161a218c-17f0-48d6-9829-b2c885ad5a1a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:05.253528 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c1bf8cd2-f13f-4bb3-a99d-f4d678f37a31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:05.255141 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c1bf8cd2-f13f-4bb3-a99d-f4d678f37a31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:05.256303 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c1bf8cd2-f13f-4bb3-a99d-f4d678f37a31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.226001 Aug 17 07:30:05.257051 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 210/420] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:30:05 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:30:05.257895 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-161a218c-17f0-48d6-9829-b2c885ad5a1a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1357 microversion: 2.1 time: 0.244895 Aug 17 07:30:05.271747 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 211/421] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:05 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:06.278905 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-51903dc9-8a97-4ef4-87cb-74f1e57b607c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:06.279509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-51903dc9-8a97-4ef4-87cb-74f1e57b607c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:06.281765 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3304ee56-54e7-4de4-be41-710a34624e63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:06.282482 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-3304ee56-54e7-4de4-be41-710a34624e63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:06.286617 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-51903dc9-8a97-4ef4-87cb-74f1e57b607c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:06.287373 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-51903dc9-8a97-4ef4-87cb-74f1e57b607c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:06.287550 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-51903dc9-8a97-4ef4-87cb-74f1e57b607c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:06.288224 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-51903dc9-8a97-4ef4-87cb-74f1e57b607c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:06.288678 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-51903dc9-8a97-4ef4-87cb-74f1e57b607c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:06.289102 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-51903dc9-8a97-4ef4-87cb-74f1e57b607c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:06.291165 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3304ee56-54e7-4de4-be41-710a34624e63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:06.291657 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3304ee56-54e7-4de4-be41-710a34624e63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:06.292093 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3304ee56-54e7-4de4-be41-710a34624e63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:06.292799 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3304ee56-54e7-4de4-be41-710a34624e63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:06.293245 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3304ee56-54e7-4de4-be41-710a34624e63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:06.293861 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3304ee56-54e7-4de4-be41-710a34624e63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:06.298517 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=100 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:06.493555 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-51903dc9-8a97-4ef4-87cb-74f1e57b607c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:06.501208 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-51903dc9-8a97-4ef4-87cb-74f1e57b607c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1357 microversion: 2.1 time: 0.226049 Aug 17 07:30:06.501742 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 211/422] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:06 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:06.511793 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3304ee56-54e7-4de4-be41-710a34624e63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:06.523095 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3304ee56-54e7-4de4-be41-710a34624e63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:06.524732 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3304ee56-54e7-4de4-be41-710a34624e63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:06.526013 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-3304ee56-54e7-4de4-be41-710a34624e63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.248647 Aug 17 07:30:06.526681 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 212/423] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:30:06 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:30:07.523382 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1ca1c2a4-8815-40d4-a5ef-6d38b6daac96 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:07.523985 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-1ca1c2a4-8815-40d4-a5ef-6d38b6daac96 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:07.530625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1ca1c2a4-8815-40d4-a5ef-6d38b6daac96 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:07.531176 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1ca1c2a4-8815-40d4-a5ef-6d38b6daac96 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:07.531607 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1ca1c2a4-8815-40d4-a5ef-6d38b6daac96 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:07.532321 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1ca1c2a4-8815-40d4-a5ef-6d38b6daac96 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:07.532764 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1ca1c2a4-8815-40d4-a5ef-6d38b6daac96 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:07.533176 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1ca1c2a4-8815-40d4-a5ef-6d38b6daac96 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:07.550910 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-006fc394-b659-488b-b687-5771eac74f33 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:07.551531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-006fc394-b659-488b-b687-5771eac74f33 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:07.558087 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-006fc394-b659-488b-b687-5771eac74f33 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:07.558802 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-006fc394-b659-488b-b687-5771eac74f33 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:07.559234 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-006fc394-b659-488b-b687-5771eac74f33 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:07.559927 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-006fc394-b659-488b-b687-5771eac74f33 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:07.560373 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-006fc394-b659-488b-b687-5771eac74f33 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:07.560790 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-006fc394-b659-488b-b687-5771eac74f33 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:07.738819 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-1ca1c2a4-8815-40d4-a5ef-6d38b6daac96 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:07.743702 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-006fc394-b659-488b-b687-5771eac74f33 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:07.747513 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-1ca1c2a4-8815-40d4-a5ef-6d38b6daac96 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1357 microversion: 2.1 time: 0.228051 Aug 17 07:30:07.748293 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 212/424] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:07 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1357 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:07.757824 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-006fc394-b659-488b-b687-5771eac74f33 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:07.759356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-006fc394-b659-488b-b687-5771eac74f33 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:07.760512 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-006fc394-b659-488b-b687-5771eac74f33 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.214300 Aug 17 07:30:07.761054 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 213/425] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:30:07 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:30:08.768293 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9d3bab7a-ee43-4911-a1ff-9a46d1f39b7f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:08.768924 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9d3bab7a-ee43-4911-a1ff-9a46d1f39b7f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:08.775247 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9d3bab7a-ee43-4911-a1ff-9a46d1f39b7f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:08.775716 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9d3bab7a-ee43-4911-a1ff-9a46d1f39b7f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:08.776143 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9d3bab7a-ee43-4911-a1ff-9a46d1f39b7f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:08.776821 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9d3bab7a-ee43-4911-a1ff-9a46d1f39b7f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:08.777271 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9d3bab7a-ee43-4911-a1ff-9a46d1f39b7f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:08.777688 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9d3bab7a-ee43-4911-a1ff-9a46d1f39b7f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:08.781920 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:08.783101 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b4858cfb-1726-4d23-b229-4aef6881cd16 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:08.783750 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-b4858cfb-1726-4d23-b229-4aef6881cd16 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:08.790637 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b4858cfb-1726-4d23-b229-4aef6881cd16 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:08.790987 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b4858cfb-1726-4d23-b229-4aef6881cd16 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:08.791450 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b4858cfb-1726-4d23-b229-4aef6881cd16 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:08.792140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b4858cfb-1726-4d23-b229-4aef6881cd16 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:08.792620 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b4858cfb-1726-4d23-b229-4aef6881cd16 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:08.793050 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b4858cfb-1726-4d23-b229-4aef6881cd16 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:08.966471 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-9d3bab7a-ee43-4911-a1ff-9a46d1f39b7f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:08.974776 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9d3bab7a-ee43-4911-a1ff-9a46d1f39b7f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1357 microversion: 2.1 time: 0.210253 Aug 17 07:30:08.975514 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 213/426] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:08 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:08.987818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b4858cfb-1726-4d23-b229-4aef6881cd16 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:08.996664 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b4858cfb-1726-4d23-b229-4aef6881cd16 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:08.998198 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b4858cfb-1726-4d23-b229-4aef6881cd16 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:08.999347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b4858cfb-1726-4d23-b229-4aef6881cd16 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.220157 Aug 17 07:30:08.999899 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 214/427] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:30:08 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:30:09.996403 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-592c38a7-b55c-4f6b-b87a-388376666fd6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:09.997119 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-592c38a7-b55c-4f6b-b87a-388376666fd6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:10.004136 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-592c38a7-b55c-4f6b-b87a-388376666fd6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:10.004693 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-592c38a7-b55c-4f6b-b87a-388376666fd6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:10.005193 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-592c38a7-b55c-4f6b-b87a-388376666fd6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:10.005887 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-592c38a7-b55c-4f6b-b87a-388376666fd6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:10.006397 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-592c38a7-b55c-4f6b-b87a-388376666fd6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:10.006819 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-592c38a7-b55c-4f6b-b87a-388376666fd6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:10.021452 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-aca64f71-f487-42fb-b358-52b5163217c5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:10.022764 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-aca64f71-f487-42fb-b358-52b5163217c5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:10.029272 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aca64f71-f487-42fb-b358-52b5163217c5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:10.029745 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aca64f71-f487-42fb-b358-52b5163217c5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:10.030200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aca64f71-f487-42fb-b358-52b5163217c5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:10.030895 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aca64f71-f487-42fb-b358-52b5163217c5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:10.031340 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aca64f71-f487-42fb-b358-52b5163217c5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:10.031767 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aca64f71-f487-42fb-b358-52b5163217c5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:10.202885 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-592c38a7-b55c-4f6b-b87a-388376666fd6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:10.214565 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-592c38a7-b55c-4f6b-b87a-388376666fd6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1357 microversion: 2.1 time: 0.222153 Aug 17 07:30:10.215496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 214/428] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:09 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1357 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:30:10.230203 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-aca64f71-f487-42fb-b358-52b5163217c5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:10.239727 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-aca64f71-f487-42fb-b358-52b5163217c5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:10.241364 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-aca64f71-f487-42fb-b358-52b5163217c5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:10.243236 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-aca64f71-f487-42fb-b358-52b5163217c5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.226372 Aug 17 07:30:10.243900 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 215/429] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:30:10 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:30:11.235486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-37f6d7ec-024b-41ca-b816-bcea9a3c206e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:11.236095 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-37f6d7ec-024b-41ca-b816-bcea9a3c206e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:11.242865 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-37f6d7ec-024b-41ca-b816-bcea9a3c206e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:11.243340 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-37f6d7ec-024b-41ca-b816-bcea9a3c206e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:11.243773 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-37f6d7ec-024b-41ca-b816-bcea9a3c206e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:11.244457 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-37f6d7ec-024b-41ca-b816-bcea9a3c206e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:11.244906 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-37f6d7ec-024b-41ca-b816-bcea9a3c206e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:11.245331 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-37f6d7ec-024b-41ca-b816-bcea9a3c206e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:11.265837 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-01311a53-1c4b-4b70-8003-9f5c6e4d8572 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:11.266642 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-01311a53-1c4b-4b70-8003-9f5c6e4d8572 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:11.273507 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-01311a53-1c4b-4b70-8003-9f5c6e4d8572 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:11.274019 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-01311a53-1c4b-4b70-8003-9f5c6e4d8572 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:11.274445 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-01311a53-1c4b-4b70-8003-9f5c6e4d8572 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:11.275130 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-01311a53-1c4b-4b70-8003-9f5c6e4d8572 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:11.275573 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-01311a53-1c4b-4b70-8003-9f5c6e4d8572 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:11.275996 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-01311a53-1c4b-4b70-8003-9f5c6e4d8572 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:11.432088 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-37f6d7ec-024b-41ca-b816-bcea9a3c206e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:11.439504 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-37f6d7ec-024b-41ca-b816-bcea9a3c206e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1357 microversion: 2.1 time: 0.207785 Aug 17 07:30:11.451952 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 215/430] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:11 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1357 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:11.459651 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-01311a53-1c4b-4b70-8003-9f5c6e4d8572 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:11.468844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-01311a53-1c4b-4b70-8003-9f5c6e4d8572 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:11.470489 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-01311a53-1c4b-4b70-8003-9f5c6e4d8572 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:11.471790 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-01311a53-1c4b-4b70-8003-9f5c6e4d8572 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.209894 Aug 17 07:30:11.472349 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 216/431] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:30:11 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:30:12.461117 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-e50271ec-800c-4f6e-b3ed-2f3932dffb8b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:12.461723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-e50271ec-800c-4f6e-b3ed-2f3932dffb8b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:12.468145 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e50271ec-800c-4f6e-b3ed-2f3932dffb8b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:12.468624 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e50271ec-800c-4f6e-b3ed-2f3932dffb8b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:12.469052 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e50271ec-800c-4f6e-b3ed-2f3932dffb8b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:12.469737 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e50271ec-800c-4f6e-b3ed-2f3932dffb8b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:12.470224 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e50271ec-800c-4f6e-b3ed-2f3932dffb8b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:12.470652 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e50271ec-800c-4f6e-b3ed-2f3932dffb8b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:12.493855 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-78b13f8a-aa7d-4e85-9e2c-709489de90fe tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:12.494571 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-78b13f8a-aa7d-4e85-9e2c-709489de90fe tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:12.500926 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-78b13f8a-aa7d-4e85-9e2c-709489de90fe tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:12.501468 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-78b13f8a-aa7d-4e85-9e2c-709489de90fe tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:12.501996 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-78b13f8a-aa7d-4e85-9e2c-709489de90fe tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:12.502933 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-78b13f8a-aa7d-4e85-9e2c-709489de90fe tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:12.503451 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-78b13f8a-aa7d-4e85-9e2c-709489de90fe tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:12.503938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-78b13f8a-aa7d-4e85-9e2c-709489de90fe tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:12.652627 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-e50271ec-800c-4f6e-b3ed-2f3932dffb8b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:12.661027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-e50271ec-800c-4f6e-b3ed-2f3932dffb8b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1357 microversion: 2.1 time: 0.203775 Aug 17 07:30:12.663419 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 216/432] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:12 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:12.677819 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-78b13f8a-aa7d-4e85-9e2c-709489de90fe tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:12.686250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-78b13f8a-aa7d-4e85-9e2c-709489de90fe tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:12.687765 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-78b13f8a-aa7d-4e85-9e2c-709489de90fe tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:12.688922 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-78b13f8a-aa7d-4e85-9e2c-709489de90fe tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.199147 Aug 17 07:30:12.689480 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 217/433] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:30:12 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:30:13.628967 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-c2d526c1-4d76-4ebb-ba8f-bb14d378b9f1 req-b075790c-e76a-429c-be04-79adc7978790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebfec5b-68c1-41cd-910b-e73220fc2fd6", "name": "network-vif-plugged", "status": "completed", "tag": "dc7af87b-fe16-4334-a953-7e5e2d03e8e7"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:13.638876 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-c2d526c1-4d76-4ebb-ba8f-bb14d378b9f1 req-b075790c-e76a-429c-be04-79adc7978790 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:13.639421 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-c2d526c1-4d76-4ebb-ba8f-bb14d378b9f1 req-b075790c-e76a-429c-be04-79adc7978790 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:13.639853 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-c2d526c1-4d76-4ebb-ba8f-bb14d378b9f1 req-b075790c-e76a-429c-be04-79adc7978790 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:13.653653 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-c2d526c1-4d76-4ebb-ba8f-bb14d378b9f1 req-b075790c-e76a-429c-be04-79adc7978790 service nova] Creating event network-vif-plugged:dc7af87b-fe16-4334-a953-7e5e2d03e8e7 for instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 on hv-cinder-85312 Aug 17 07:30:13.660149 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-c2d526c1-4d76-4ebb-ba8f-bb14d378b9f1 req-b075790c-e76a-429c-be04-79adc7978790 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034871 Aug 17 07:30:13.660745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 217/434] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:30:13.682098 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-aa170821-6d55-4a10-a3a9-56ef3eeb71ed tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:13.682712 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-aa170821-6d55-4a10-a3a9-56ef3eeb71ed tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:13.688828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa170821-6d55-4a10-a3a9-56ef3eeb71ed tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:13.689307 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa170821-6d55-4a10-a3a9-56ef3eeb71ed tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:13.689988 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa170821-6d55-4a10-a3a9-56ef3eeb71ed tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:13.690695 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa170821-6d55-4a10-a3a9-56ef3eeb71ed tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:13.691144 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa170821-6d55-4a10-a3a9-56ef3eeb71ed tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:13.691567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa170821-6d55-4a10-a3a9-56ef3eeb71ed tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:13.711902 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-39a19836-055a-4750-8ad1-1a71465cfc4c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:13.712946 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-39a19836-055a-4750-8ad1-1a71465cfc4c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:13.731023 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-39a19836-055a-4750-8ad1-1a71465cfc4c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:13.731694 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-39a19836-055a-4750-8ad1-1a71465cfc4c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:13.732225 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-39a19836-055a-4750-8ad1-1a71465cfc4c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:13.733028 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-39a19836-055a-4750-8ad1-1a71465cfc4c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:13.733619 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-39a19836-055a-4750-8ad1-1a71465cfc4c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:13.734224 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-39a19836-055a-4750-8ad1-1a71465cfc4c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:13.889600 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-aa170821-6d55-4a10-a3a9-56ef3eeb71ed tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:13.897655 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-aa170821-6d55-4a10-a3a9-56ef3eeb71ed tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1357 microversion: 2.1 time: 0.219929 Aug 17 07:30:13.898265 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 218/435] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:13 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:13.912695 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-39a19836-055a-4750-8ad1-1a71465cfc4c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:13.921233 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-39a19836-055a-4750-8ad1-1a71465cfc4c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:13.922788 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-39a19836-055a-4750-8ad1-1a71465cfc4c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:13.923971 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-39a19836-055a-4750-8ad1-1a71465cfc4c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.216284 Aug 17 07:30:13.924719 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 218/436] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:30:13 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:30:14.918928 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-18bbc491-bcde-47d3-9121-a5a3554abaa6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:14.919540 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-18bbc491-bcde-47d3-9121-a5a3554abaa6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:14.926526 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-18bbc491-bcde-47d3-9121-a5a3554abaa6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:14.926998 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-18bbc491-bcde-47d3-9121-a5a3554abaa6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:14.927430 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-18bbc491-bcde-47d3-9121-a5a3554abaa6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:14.928122 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-18bbc491-bcde-47d3-9121-a5a3554abaa6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:14.928573 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-18bbc491-bcde-47d3-9121-a5a3554abaa6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:14.928998 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-18bbc491-bcde-47d3-9121-a5a3554abaa6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:14.947089 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-45d5d02a-cecd-437a-bc1a-5c33d38cea90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:14.947691 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-45d5d02a-cecd-437a-bc1a-5c33d38cea90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:14.954275 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-45d5d02a-cecd-437a-bc1a-5c33d38cea90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:14.954976 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-45d5d02a-cecd-437a-bc1a-5c33d38cea90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:14.955431 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-45d5d02a-cecd-437a-bc1a-5c33d38cea90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:14.956124 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-45d5d02a-cecd-437a-bc1a-5c33d38cea90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:14.956809 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-45d5d02a-cecd-437a-bc1a-5c33d38cea90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:14.957311 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-45d5d02a-cecd-437a-bc1a-5c33d38cea90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:15.133912 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-18bbc491-bcde-47d3-9121-a5a3554abaa6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:15.137537 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-45d5d02a-cecd-437a-bc1a-5c33d38cea90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:15.142204 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-18bbc491-bcde-47d3-9121-a5a3554abaa6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1357 microversion: 2.1 time: 0.227038 Aug 17 07:30:15.143076 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 219/437] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:14 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:15.158287 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-45d5d02a-cecd-437a-bc1a-5c33d38cea90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:15.160367 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-45d5d02a-cecd-437a-bc1a-5c33d38cea90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:15.161534 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-45d5d02a-cecd-437a-bc1a-5c33d38cea90 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.218416 Aug 17 07:30:15.162100 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 219/438] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:30:14 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:30:15.684727 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-40b51c5f-c871-4e04-8b39-fd829100e48b req-95c4ef41-5108-4450-9b9a-5014c1958c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a37385c-cdcc-4d52-89c4-241744d2d17d", "name": "network-vif-plugged", "status": "completed", "tag": "fb3fc6d2-2e3d-4fa5-979a-023f68ad390f"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:15.694063 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-40b51c5f-c871-4e04-8b39-fd829100e48b req-95c4ef41-5108-4450-9b9a-5014c1958c1c service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:15.694531 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-40b51c5f-c871-4e04-8b39-fd829100e48b req-95c4ef41-5108-4450-9b9a-5014c1958c1c service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:15.694953 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-40b51c5f-c871-4e04-8b39-fd829100e48b req-95c4ef41-5108-4450-9b9a-5014c1958c1c service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:15.705770 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-40b51c5f-c871-4e04-8b39-fd829100e48b req-95c4ef41-5108-4450-9b9a-5014c1958c1c service nova] Creating event network-vif-plugged:fb3fc6d2-2e3d-4fa5-979a-023f68ad390f for instance 4a37385c-cdcc-4d52-89c4-241744d2d17d on hv-cinder-85312 Aug 17 07:30:15.710890 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-40b51c5f-c871-4e04-8b39-fd829100e48b req-95c4ef41-5108-4450-9b9a-5014c1958c1c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029840 Aug 17 07:30:15.711452 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 220/439] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:30:16.162399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c6d86416-ddf3-4ba5-9c34-b1d575347d34 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:16.163016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c6d86416-ddf3-4ba5-9c34-b1d575347d34 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:16.169247 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c6d86416-ddf3-4ba5-9c34-b1d575347d34 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:16.169725 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c6d86416-ddf3-4ba5-9c34-b1d575347d34 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:16.170211 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c6d86416-ddf3-4ba5-9c34-b1d575347d34 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:16.170897 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c6d86416-ddf3-4ba5-9c34-b1d575347d34 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:16.171345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c6d86416-ddf3-4ba5-9c34-b1d575347d34 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:16.171764 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c6d86416-ddf3-4ba5-9c34-b1d575347d34 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:16.188990 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-112c7c21-2cfe-44dc-bca6-1d8a52c1f364 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:16.192062 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-112c7c21-2cfe-44dc-bca6-1d8a52c1f364 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:16.198930 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-112c7c21-2cfe-44dc-bca6-1d8a52c1f364 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:16.199478 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-112c7c21-2cfe-44dc-bca6-1d8a52c1f364 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:16.200001 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-112c7c21-2cfe-44dc-bca6-1d8a52c1f364 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:16.200757 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-112c7c21-2cfe-44dc-bca6-1d8a52c1f364 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:16.201271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-112c7c21-2cfe-44dc-bca6-1d8a52c1f364 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:16.201754 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-112c7c21-2cfe-44dc-bca6-1d8a52c1f364 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:16.364703 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c6d86416-ddf3-4ba5-9c34-b1d575347d34 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:16.373184 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c6d86416-ddf3-4ba5-9c34-b1d575347d34 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1357 microversion: 2.1 time: 0.214500 Aug 17 07:30:16.375462 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 220/440] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:16 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1357 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:16.384490 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-112c7c21-2cfe-44dc-bca6-1d8a52c1f364 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:16.394013 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-112c7c21-2cfe-44dc-bca6-1d8a52c1f364 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:16.395391 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-112c7c21-2cfe-44dc-bca6-1d8a52c1f364 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:16.396665 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-112c7c21-2cfe-44dc-bca6-1d8a52c1f364 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1807 microversion: 2.20 time: 0.216532 Aug 17 07:30:16.406768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 221/441] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:30:16 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:30:17.317372 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0854128b-cdeb-4ce0-8989-d05a7857cadb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:17.319640 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0854128b-cdeb-4ce0-8989-d05a7857cadb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:17.326955 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0854128b-cdeb-4ce0-8989-d05a7857cadb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:17.327441 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0854128b-cdeb-4ce0-8989-d05a7857cadb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:17.327883 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0854128b-cdeb-4ce0-8989-d05a7857cadb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:17.328586 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0854128b-cdeb-4ce0-8989-d05a7857cadb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:17.329041 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0854128b-cdeb-4ce0-8989-d05a7857cadb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:17.329470 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0854128b-cdeb-4ce0-8989-d05a7857cadb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:17.352861 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.objects.instance [None req-0854128b-cdeb-4ce0-8989-d05a7857cadb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lazy-loading 'flavor' on Instance uuid 1f58c6a6-fa9c-4795-97c2-525c1510124b {{(pid=120834) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:30:17.396204 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d24bc20b-bcc7-42c7-afaa-3cbaa17b9564 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:17.396806 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d24bc20b-bcc7-42c7-afaa-3cbaa17b9564 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:17.403303 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d24bc20b-bcc7-42c7-afaa-3cbaa17b9564 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:17.403783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d24bc20b-bcc7-42c7-afaa-3cbaa17b9564 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:17.404216 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d24bc20b-bcc7-42c7-afaa-3cbaa17b9564 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:17.404903 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d24bc20b-bcc7-42c7-afaa-3cbaa17b9564 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:17.405550 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d24bc20b-bcc7-42c7-afaa-3cbaa17b9564 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:17.407041 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d24bc20b-bcc7-42c7-afaa-3cbaa17b9564 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:17.514212 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0854128b-cdeb-4ce0-8989-d05a7857cadb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "POST /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/action" status: 200 len: 32 microversion: 2.1 time: 0.201596 Aug 17 07:30:17.514820 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 221/442] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 17 07:30:17 2022] POST /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/action => generated 32 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 07:30:17.519800 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-8dfabe94-ae15-4d57-96ad-62b28791a87a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:17.520482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-8dfabe94-ae15-4d57-96ad-62b28791a87a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:17.526671 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8dfabe94-ae15-4d57-96ad-62b28791a87a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:17.527149 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8dfabe94-ae15-4d57-96ad-62b28791a87a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:17.528322 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8dfabe94-ae15-4d57-96ad-62b28791a87a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:17.529017 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8dfabe94-ae15-4d57-96ad-62b28791a87a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:17.529463 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8dfabe94-ae15-4d57-96ad-62b28791a87a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:17.529882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8dfabe94-ae15-4d57-96ad-62b28791a87a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:17.544030 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d24bc20b-bcc7-42c7-afaa-3cbaa17b9564 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:17.551881 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d24bc20b-bcc7-42c7-afaa-3cbaa17b9564 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1357 microversion: 2.1 time: 0.160314 Aug 17 07:30:17.552448 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 222/443] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:17 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:30:17.557158 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b034bfec-812d-4b36-bde2-c666c87c03ea tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:17.557762 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-b034bfec-812d-4b36-bde2-c666c87c03ea tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:17.563394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b034bfec-812d-4b36-bde2-c666c87c03ea tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:17.563868 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b034bfec-812d-4b36-bde2-c666c87c03ea tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:17.564308 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b034bfec-812d-4b36-bde2-c666c87c03ea tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:17.565032 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b034bfec-812d-4b36-bde2-c666c87c03ea tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:17.565490 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b034bfec-812d-4b36-bde2-c666c87c03ea tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:17.565915 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b034bfec-812d-4b36-bde2-c666c87c03ea tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:17.733502 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-8dfabe94-ae15-4d57-96ad-62b28791a87a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:17.737472 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b034bfec-812d-4b36-bde2-c666c87c03ea tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:17.742627 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-8dfabe94-ae15-4d57-96ad-62b28791a87a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:17.744139 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-8dfabe94-ae15-4d57-96ad-62b28791a87a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:17.745389 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-8dfabe94-ae15-4d57-96ad-62b28791a87a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1794 microversion: 2.20 time: 0.229519 Aug 17 07:30:17.745676 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b034bfec-812d-4b36-bde2-c666c87c03ea tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1737 microversion: 2.1 time: 0.192088 Aug 17 07:30:17.745939 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 222/444] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:30:17 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1794 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:30:17.746257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 223/445] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:17 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:18.572691 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-49847451-2262-4062-8e24-3d04f8b0c1b5 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:18.573289 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-49847451-2262-4062-8e24-3d04f8b0c1b5 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:18.579642 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-49847451-2262-4062-8e24-3d04f8b0c1b5 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:18.580150 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-49847451-2262-4062-8e24-3d04f8b0c1b5 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:18.581093 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-49847451-2262-4062-8e24-3d04f8b0c1b5 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:18.581774 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-49847451-2262-4062-8e24-3d04f8b0c1b5 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:18.582248 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-49847451-2262-4062-8e24-3d04f8b0c1b5 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:18.582666 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-49847451-2262-4062-8e24-3d04f8b0c1b5 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:18.708454 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-49847451-2262-4062-8e24-3d04f8b0c1b5 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:18.715812 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-49847451-2262-4062-8e24-3d04f8b0c1b5 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1357 microversion: 2.1 time: 0.147008 Aug 17 07:30:18.716354 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 223/446] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:18 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:18.766326 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-054d91f3-d917-4d72-a473-96bb3437b06d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:18.766936 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-054d91f3-d917-4d72-a473-96bb3437b06d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:18.773290 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-054d91f3-d917-4d72-a473-96bb3437b06d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:18.773762 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-054d91f3-d917-4d72-a473-96bb3437b06d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:18.774237 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-054d91f3-d917-4d72-a473-96bb3437b06d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:18.774924 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-054d91f3-d917-4d72-a473-96bb3437b06d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:18.775371 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-054d91f3-d917-4d72-a473-96bb3437b06d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:18.775792 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-054d91f3-d917-4d72-a473-96bb3437b06d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:18.906194 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-054d91f3-d917-4d72-a473-96bb3437b06d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:18.914829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-054d91f3-d917-4d72-a473-96bb3437b06d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1737 microversion: 2.1 time: 0.152186 Aug 17 07:30:18.915326 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 224/447] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:18 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:19.736662 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b2201de6-6847-4639-8e1c-9f3945b564f3 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:19.737276 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-b2201de6-6847-4639-8e1c-9f3945b564f3 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:19.744057 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b2201de6-6847-4639-8e1c-9f3945b564f3 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:19.744535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b2201de6-6847-4639-8e1c-9f3945b564f3 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:19.744966 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b2201de6-6847-4639-8e1c-9f3945b564f3 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:19.745648 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b2201de6-6847-4639-8e1c-9f3945b564f3 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:19.746144 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b2201de6-6847-4639-8e1c-9f3945b564f3 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:19.746570 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b2201de6-6847-4639-8e1c-9f3945b564f3 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:19.873339 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-b2201de6-6847-4639-8e1c-9f3945b564f3 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:19.881515 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b2201de6-6847-4639-8e1c-9f3945b564f3 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1357 microversion: 2.1 time: 0.148789 Aug 17 07:30:19.882105 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 224/448] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:19 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:19.936248 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-f6b8354c-52bc-4fbf-a8df-1da3180b3413 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:19.936850 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-f6b8354c-52bc-4fbf-a8df-1da3180b3413 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:19.943784 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f6b8354c-52bc-4fbf-a8df-1da3180b3413 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:19.944251 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f6b8354c-52bc-4fbf-a8df-1da3180b3413 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:19.944683 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f6b8354c-52bc-4fbf-a8df-1da3180b3413 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:19.945359 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f6b8354c-52bc-4fbf-a8df-1da3180b3413 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:19.945868 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f6b8354c-52bc-4fbf-a8df-1da3180b3413 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:19.946317 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f6b8354c-52bc-4fbf-a8df-1da3180b3413 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:20.074313 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-f6b8354c-52bc-4fbf-a8df-1da3180b3413 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:20.082752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-f6b8354c-52bc-4fbf-a8df-1da3180b3413 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1737 microversion: 2.1 time: 0.150251 Aug 17 07:30:20.083314 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 225/449] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:19 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:20.902815 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-d98ea7cf-255f-4aad-ab93-d4f4d3ccd890 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:20.903417 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-d98ea7cf-255f-4aad-ab93-d4f4d3ccd890 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:20.909741 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d98ea7cf-255f-4aad-ab93-d4f4d3ccd890 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:20.910240 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d98ea7cf-255f-4aad-ab93-d4f4d3ccd890 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:20.910670 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d98ea7cf-255f-4aad-ab93-d4f4d3ccd890 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:20.911344 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d98ea7cf-255f-4aad-ab93-d4f4d3ccd890 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:20.911789 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d98ea7cf-255f-4aad-ab93-d4f4d3ccd890 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:20.912236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d98ea7cf-255f-4aad-ab93-d4f4d3ccd890 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:21.040995 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-d98ea7cf-255f-4aad-ab93-d4f4d3ccd890 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:21.048631 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-d98ea7cf-255f-4aad-ab93-d4f4d3ccd890 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1547 microversion: 2.1 time: 0.149600 Aug 17 07:30:21.049851 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 225/450] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:20 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:21.069209 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-7038da41-b33f-4643-8b33-d6b78cb5dc2e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:21.069817 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-7038da41-b33f-4643-8b33-d6b78cb5dc2e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:21.076279 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7038da41-b33f-4643-8b33-d6b78cb5dc2e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:21.076738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7038da41-b33f-4643-8b33-d6b78cb5dc2e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:21.077170 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7038da41-b33f-4643-8b33-d6b78cb5dc2e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:21.077853 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7038da41-b33f-4643-8b33-d6b78cb5dc2e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:21.078364 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7038da41-b33f-4643-8b33-d6b78cb5dc2e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:21.078785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7038da41-b33f-4643-8b33-d6b78cb5dc2e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:21.103217 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-30fb3c25-4864-4a18-ab70-e185839d4b53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:21.103851 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-30fb3c25-4864-4a18-ab70-e185839d4b53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:21.109712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-30fb3c25-4864-4a18-ab70-e185839d4b53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:21.110230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-30fb3c25-4864-4a18-ab70-e185839d4b53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:21.110669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-30fb3c25-4864-4a18-ab70-e185839d4b53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:21.111422 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-30fb3c25-4864-4a18-ab70-e185839d4b53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:21.112388 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-30fb3c25-4864-4a18-ab70-e185839d4b53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:21.112813 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-30fb3c25-4864-4a18-ab70-e185839d4b53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:21.261228 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-7038da41-b33f-4643-8b33-d6b78cb5dc2e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:21.268562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-7038da41-b33f-4643-8b33-d6b78cb5dc2e tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1547 microversion: 2.1 time: 0.203195 Aug 17 07:30:21.269124 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 226/451] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:21 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1547 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:21.282353 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-30fb3c25-4864-4a18-ab70-e185839d4b53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:21.289020 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e3dbd3df-f677-4705-ad30-e198f7923a83 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:21.290864 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-30fb3c25-4864-4a18-ab70-e185839d4b53 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1737 microversion: 2.1 time: 0.191432 Aug 17 07:30:21.291578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 226/452] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:21 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:30:21.293747 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-e3dbd3df-f677-4705-ad30-e198f7923a83 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:21.294543 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e3dbd3df-f677-4705-ad30-e198f7923a83 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Searching by: {'deleted': False, 'project_id': '5192a78d86bc40ae96a3cbb283992463'} {{(pid=120835) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 17 07:30:21.301608 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e3dbd3df-f677-4705-ad30-e198f7923a83 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:21.302113 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e3dbd3df-f677-4705-ad30-e198f7923a83 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:21.302544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e3dbd3df-f677-4705-ad30-e198f7923a83 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:21.303266 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e3dbd3df-f677-4705-ad30-e198f7923a83 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:21.303715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e3dbd3df-f677-4705-ad30-e198f7923a83 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:21.304135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e3dbd3df-f677-4705-ad30-e198f7923a83 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:21.395336 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.multi_cell_list [None req-e3dbd3df-f677-4705-ad30-e198f7923a83 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120835) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 17 07:30:21.487486 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e3dbd3df-f677-4705-ad30-e198f7923a83 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202034 Aug 17 07:30:21.488069 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 227/453] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Aug 17 07:30:21 2022] GET /compute/v2.1/servers => generated 343 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:30:21.499276 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-afbe6255-a610-4f23-8806-e696b9665b2b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:21.499885 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-afbe6255-a610-4f23-8806-e696b9665b2b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:21.501804 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=56 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:21.506941 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-afbe6255-a610-4f23-8806-e696b9665b2b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:21.507444 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-afbe6255-a610-4f23-8806-e696b9665b2b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:21.507882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-afbe6255-a610-4f23-8806-e696b9665b2b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:21.508563 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-afbe6255-a610-4f23-8806-e696b9665b2b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:21.509010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-afbe6255-a610-4f23-8806-e696b9665b2b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:21.509435 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-afbe6255-a610-4f23-8806-e696b9665b2b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:21.637211 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-afbe6255-a610-4f23-8806-e696b9665b2b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:21.645063 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-afbe6255-a610-4f23-8806-e696b9665b2b tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1547 microversion: 2.1 time: 0.149528 Aug 17 07:30:21.645621 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 227/454] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:21 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:22.312674 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c0dd4229-936e-40ea-90a9-687b439d4990 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:22.313283 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-c0dd4229-936e-40ea-90a9-687b439d4990 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:22.320319 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c0dd4229-936e-40ea-90a9-687b439d4990 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:22.320794 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c0dd4229-936e-40ea-90a9-687b439d4990 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:22.321222 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c0dd4229-936e-40ea-90a9-687b439d4990 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:22.321905 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c0dd4229-936e-40ea-90a9-687b439d4990 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:22.322379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c0dd4229-936e-40ea-90a9-687b439d4990 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:22.322799 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c0dd4229-936e-40ea-90a9-687b439d4990 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:22.452752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c0dd4229-936e-40ea-90a9-687b439d4990 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:22.460598 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-c0dd4229-936e-40ea-90a9-687b439d4990 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1737 microversion: 2.1 time: 0.151878 Aug 17 07:30:22.461173 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 228/455] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:22 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:30:23.175651 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ca57cf83-362f-4746-8ce8-9cda6076c41c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c4cbc02-fc75-4640-b404-ae2eba0682e3"}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:23.178277 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ca57cf83-362f-4746-8ce8-9cda6076c41c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:23.184960 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ca57cf83-362f-4746-8ce8-9cda6076c41c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:23.185447 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ca57cf83-362f-4746-8ce8-9cda6076c41c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:23.185883 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ca57cf83-362f-4746-8ce8-9cda6076c41c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:23.186775 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ca57cf83-362f-4746-8ce8-9cda6076c41c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:23.187229 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ca57cf83-362f-4746-8ce8-9cda6076c41c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:23.187656 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ca57cf83-362f-4746-8ce8-9cda6076c41c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:23.201618 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:23.445950 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ca57cf83-362f-4746-8ce8-9cda6076c41c tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "POST /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275313 Aug 17 07:30:23.446608 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 228/456] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 17 07:30:23 2022] POST /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:30:23.482345 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-4ca0357f-b26a-4a99-8db4-496480d52a02 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:23.482983 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-4ca0357f-b26a-4a99-8db4-496480d52a02 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:23.489371 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4ca0357f-b26a-4a99-8db4-496480d52a02 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:23.489852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4ca0357f-b26a-4a99-8db4-496480d52a02 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:23.490309 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4ca0357f-b26a-4a99-8db4-496480d52a02 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:23.491682 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4ca0357f-b26a-4a99-8db4-496480d52a02 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:23.492397 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4ca0357f-b26a-4a99-8db4-496480d52a02 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:23.492820 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4ca0357f-b26a-4a99-8db4-496480d52a02 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:23.497272 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=100 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:23.625211 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-4ca0357f-b26a-4a99-8db4-496480d52a02 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:23.633770 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-4ca0357f-b26a-4a99-8db4-496480d52a02 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1737 microversion: 2.1 time: 0.155806 Aug 17 07:30:23.634463 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 229/457] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:23 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:24.656874 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-15ab5572-946a-4ef8-aea1-081505fa816d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:24.657498 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-15ab5572-946a-4ef8-aea1-081505fa816d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:24.664235 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-15ab5572-946a-4ef8-aea1-081505fa816d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:24.664705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-15ab5572-946a-4ef8-aea1-081505fa816d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:24.665138 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-15ab5572-946a-4ef8-aea1-081505fa816d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:24.665819 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-15ab5572-946a-4ef8-aea1-081505fa816d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:24.666297 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-15ab5572-946a-4ef8-aea1-081505fa816d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:24.666719 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-15ab5572-946a-4ef8-aea1-081505fa816d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:24.793162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-15ab5572-946a-4ef8-aea1-081505fa816d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:24.801046 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-15ab5572-946a-4ef8-aea1-081505fa816d tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1737 microversion: 2.1 time: 0.148866 Aug 17 07:30:24.801600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 229/458] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:24 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:25.822735 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d3b1a158-45ec-4a10-a972-08d4208ee4ff tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:25.823414 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d3b1a158-45ec-4a10-a972-08d4208ee4ff tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:25.826047 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=55 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:25.831471 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d3b1a158-45ec-4a10-a972-08d4208ee4ff tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:25.831948 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d3b1a158-45ec-4a10-a972-08d4208ee4ff tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:25.832387 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d3b1a158-45ec-4a10-a972-08d4208ee4ff tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:25.833071 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d3b1a158-45ec-4a10-a972-08d4208ee4ff tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:25.833525 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d3b1a158-45ec-4a10-a972-08d4208ee4ff tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:25.833951 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d3b1a158-45ec-4a10-a972-08d4208ee4ff tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:25.967284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d3b1a158-45ec-4a10-a972-08d4208ee4ff tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:25.975840 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d3b1a158-45ec-4a10-a972-08d4208ee4ff tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1737 microversion: 2.1 time: 0.157073 Aug 17 07:30:25.976403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 230/459] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:25 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:26.996890 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-bac63252-beb4-409b-9476-7bcebd46c260 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:26.997506 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-bac63252-beb4-409b-9476-7bcebd46c260 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:27.004628 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bac63252-beb4-409b-9476-7bcebd46c260 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:27.005106 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bac63252-beb4-409b-9476-7bcebd46c260 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:27.005576 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bac63252-beb4-409b-9476-7bcebd46c260 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:27.006322 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bac63252-beb4-409b-9476-7bcebd46c260 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:27.006785 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bac63252-beb4-409b-9476-7bcebd46c260 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:27.007206 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bac63252-beb4-409b-9476-7bcebd46c260 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:27.133922 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-bac63252-beb4-409b-9476-7bcebd46c260 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:27.141875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-bac63252-beb4-409b-9476-7bcebd46c260 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1737 microversion: 2.1 time: 0.148920 Aug 17 07:30:27.142466 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 230/460] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:26 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:28.163583 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-14095123-9fcd-48af-9fbd-b38dc08521b1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:28.164185 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-14095123-9fcd-48af-9fbd-b38dc08521b1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:28.170869 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-14095123-9fcd-48af-9fbd-b38dc08521b1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:28.171350 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-14095123-9fcd-48af-9fbd-b38dc08521b1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:28.171814 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-14095123-9fcd-48af-9fbd-b38dc08521b1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:28.172533 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-14095123-9fcd-48af-9fbd-b38dc08521b1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:28.172983 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-14095123-9fcd-48af-9fbd-b38dc08521b1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:28.173415 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-14095123-9fcd-48af-9fbd-b38dc08521b1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:28.304117 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-14095123-9fcd-48af-9fbd-b38dc08521b1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:28.312249 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-14095123-9fcd-48af-9fbd-b38dc08521b1 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1737 microversion: 2.1 time: 0.152480 Aug 17 07:30:28.312834 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 231/461] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:28 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:29.188798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-e97a9354-26eb-4a95-b3ad-e1d7f6c68b9c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:29.189349 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-e97a9354-26eb-4a95-b3ad-e1d7f6c68b9c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:29.195778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e97a9354-26eb-4a95-b3ad-e1d7f6c68b9c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:29.196251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e97a9354-26eb-4a95-b3ad-e1d7f6c68b9c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:29.196679 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e97a9354-26eb-4a95-b3ad-e1d7f6c68b9c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:29.197355 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e97a9354-26eb-4a95-b3ad-e1d7f6c68b9c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:29.197797 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e97a9354-26eb-4a95-b3ad-e1d7f6c68b9c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:29.198242 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e97a9354-26eb-4a95-b3ad-e1d7f6c68b9c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:29.222171 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-e97a9354-26eb-4a95-b3ad-e1d7f6c68b9c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27/ips" status: 200 len: 150 microversion: 2.1 time: 0.035689 Aug 17 07:30:29.222725 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 231/462] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 17 07:30:29 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:30:29.234014 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-bcfa588a-8fb3-4121-afe1-d53c0d3c776b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d50b1d8d-0e26-44b9-8b24-0844730aa827"}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:29.236307 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-bcfa588a-8fb3-4121-afe1-d53c0d3c776b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:29.243072 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bcfa588a-8fb3-4121-afe1-d53c0d3c776b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:29.243541 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bcfa588a-8fb3-4121-afe1-d53c0d3c776b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:29.243969 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bcfa588a-8fb3-4121-afe1-d53c0d3c776b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:29.244644 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bcfa588a-8fb3-4121-afe1-d53c0d3c776b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:29.245088 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bcfa588a-8fb3-4121-afe1-d53c0d3c776b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:29.245504 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bcfa588a-8fb3-4121-afe1-d53c0d3c776b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:29.323134 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-bcfa588a-8fb3-4121-afe1-d53c0d3c776b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] HTTP exception thrown: Invalid volume: volume d50b1d8d-0e26-44b9-8b24-0844730aa827 is already attached to instances: 15365fa0-3501-49cd-a3d5-9ac53d13169f Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-bcfa588a-8fb3-4121-afe1-d53c0d3c776b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Request method failure captured: Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: POST /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27/os-volume_attachments HTTP/1.1 Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 74 Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JhGMmtOHPQ5tXMBLT1ZWRDn92BoL8xS5HEV9kJ9w-VnlQw7GKIuWmct0Qgt_en_280xO3qINH5E37EeabHnDI9eZ1ASkmK0KnVQ204joQi6gbsZ95MMAexn68sEvntVaw9I7_UKoZlfQdjEqiEYm3qsshCMucpzh5z8w4kUhehd2Ow Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:30:29.324844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:30:29.326433 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}] Aug 17 07:30:29.326433 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:30:29.326433 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:30:29.326433 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:30:29.326433 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:30:29.326433 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:30:29.326433 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:30:29.326433 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: f8b0c96c80db4db4a477a1fa6c1fa4db Aug 17 07:30:29.326433 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:30:29.326433 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Aug 17 07:30:29.326433 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {"volumeAttachment": {"volumeId": "d50b1d8d-0e26-44b9-8b24-0844730aa827"}} Aug 17 07:30:29.326433 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Invalid volume: volume d50b1d8d-0e26-44b9-8b24-0844730aa827 is already attached to instances: 15365fa0-3501-49cd-a3d5-9ac53d13169f Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'server_id': 'ebe690bb-f5a6-4080-aad0-4e79bf213d27', 'body': {'volumeAttachment': {'volumeId': 'd50b1d8d-0e26-44b9-8b24-0844730aa827'}}} Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d50b1d8d-0e26-44b9-8b24-0844730aa827 is already attached to instances: 15365fa0-3501-49cd-a3d5-9ac53d13169f Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:30:29.327324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d50b1d8d-0e26-44b9-8b24-0844730aa827 is already attached to instances: 15365fa0-3501-49cd-a3d5-9ac53d13169f Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:30:29.328852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:30:29.330915 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:30:29.330915 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:30:29.330915 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:30:29.330915 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d50b1d8d-0e26-44b9-8b24-0844730aa827 is already attached to instances: 15365fa0-3501-49cd-a3d5-9ac53d13169f Aug 17 07:30:29.330915 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:30:29.330915 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-bcfa588a-8fb3-4121-afe1-d53c0d3c776b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Returning 400 to user: Invalid volume: volume d50b1d8d-0e26-44b9-8b24-0844730aa827 is already attached to instances: 15365fa0-3501-49cd-a3d5-9ac53d13169f {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:30:29.330915 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-bcfa588a-8fb3-4121-afe1-d53c0d3c776b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "POST /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096362 Aug 17 07:30:29.330915 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 232/463] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 17 07:30:29 2022] POST /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 17 07:30:29.335940 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-3eb4e6e8-453a-4049-9bb3-b73ca6a39327 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:29.336168 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-66b96b03-6852-4155-a332-630e3d54916e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:29.336541 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-3eb4e6e8-453a-4049-9bb3-b73ca6a39327 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:29.336649 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-66b96b03-6852-4155-a332-630e3d54916e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:29.343867 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-66b96b03-6852-4155-a332-630e3d54916e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:29.344348 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-66b96b03-6852-4155-a332-630e3d54916e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:29.344778 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-66b96b03-6852-4155-a332-630e3d54916e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:29.344892 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3eb4e6e8-453a-4049-9bb3-b73ca6a39327 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:29.345323 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3eb4e6e8-453a-4049-9bb3-b73ca6a39327 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:29.345516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-66b96b03-6852-4155-a332-630e3d54916e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:29.350782 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-66b96b03-6852-4155-a332-630e3d54916e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:29.350968 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3eb4e6e8-453a-4049-9bb3-b73ca6a39327 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:29.351079 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-66b96b03-6852-4155-a332-630e3d54916e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:29.351174 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3eb4e6e8-453a-4049-9bb3-b73ca6a39327 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:29.351174 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3eb4e6e8-453a-4049-9bb3-b73ca6a39327 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:29.351174 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3eb4e6e8-453a-4049-9bb3-b73ca6a39327 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:29.372372 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-66b96b03-6852-4155-a332-630e3d54916e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Going to try to terminate instance {{(pid=120835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:30:29.456133 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-66b96b03-6852-4155-a332-630e3d54916e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 204 len: 0 microversion: 2.1 time: 0.122597 Aug 17 07:30:29.459624 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 233/464] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:30:29 2022] DELETE /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:30:29.464915 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-906e29d9-3416-4dcf-a3bb-a9dbca3afdef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:29.465601 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-906e29d9-3416-4dcf-a3bb-a9dbca3afdef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:29.471378 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-906e29d9-3416-4dcf-a3bb-a9dbca3afdef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:29.471856 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-906e29d9-3416-4dcf-a3bb-a9dbca3afdef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:29.472286 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-906e29d9-3416-4dcf-a3bb-a9dbca3afdef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:29.472961 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-906e29d9-3416-4dcf-a3bb-a9dbca3afdef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:29.473405 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-906e29d9-3416-4dcf-a3bb-a9dbca3afdef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:29.473821 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-906e29d9-3416-4dcf-a3bb-a9dbca3afdef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:29.481635 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-3eb4e6e8-453a-4049-9bb3-b73ca6a39327 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:29.489478 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-3eb4e6e8-453a-4049-9bb3-b73ca6a39327 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1737 microversion: 2.1 time: 0.157321 Aug 17 07:30:29.490051 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 232/465] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:29 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:30:29.604027 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-906e29d9-3416-4dcf-a3bb-a9dbca3afdef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:29.611314 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-906e29d9-3416-4dcf-a3bb-a9dbca3afdef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1682 microversion: 2.1 time: 0.150374 Aug 17 07:30:29.611871 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 234/466] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:29 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:30.511698 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-5f5943b0-4840-481d-a1fa-6c62efbfd43f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:30.512290 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-5f5943b0-4840-481d-a1fa-6c62efbfd43f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:30.519612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5f5943b0-4840-481d-a1fa-6c62efbfd43f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:30.520085 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5f5943b0-4840-481d-a1fa-6c62efbfd43f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:30.520520 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5f5943b0-4840-481d-a1fa-6c62efbfd43f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:30.521214 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5f5943b0-4840-481d-a1fa-6c62efbfd43f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:30.521664 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5f5943b0-4840-481d-a1fa-6c62efbfd43f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:30.522210 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5f5943b0-4840-481d-a1fa-6c62efbfd43f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:30.632675 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c5163290-7c6e-4dd7-bd59-7238dedd110f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:30.633295 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-c5163290-7c6e-4dd7-bd59-7238dedd110f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:30.640140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c5163290-7c6e-4dd7-bd59-7238dedd110f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:30.640709 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c5163290-7c6e-4dd7-bd59-7238dedd110f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:30.641178 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c5163290-7c6e-4dd7-bd59-7238dedd110f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:30.642115 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c5163290-7c6e-4dd7-bd59-7238dedd110f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:30.643081 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c5163290-7c6e-4dd7-bd59-7238dedd110f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:30.643512 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c5163290-7c6e-4dd7-bd59-7238dedd110f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:30.663546 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-5f5943b0-4840-481d-a1fa-6c62efbfd43f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:30.669425 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-5f5943b0-4840-481d-a1fa-6c62efbfd43f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1737 microversion: 2.1 time: 0.161578 Aug 17 07:30:30.670115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 233/467] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:30 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:30.777282 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c5163290-7c6e-4dd7-bd59-7238dedd110f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:30.785419 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-c5163290-7c6e-4dd7-bd59-7238dedd110f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1682 microversion: 2.1 time: 0.156563 Aug 17 07:30:30.786170 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 235/468] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:30 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:30:31.691021 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-561e959a-2a97-4972-bbb8-3c689c46c0d8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:31.691744 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-561e959a-2a97-4972-bbb8-3c689c46c0d8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:31.698945 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-561e959a-2a97-4972-bbb8-3c689c46c0d8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:31.699407 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-561e959a-2a97-4972-bbb8-3c689c46c0d8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:31.699934 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-561e959a-2a97-4972-bbb8-3c689c46c0d8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:31.701785 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-561e959a-2a97-4972-bbb8-3c689c46c0d8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:31.702284 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-561e959a-2a97-4972-bbb8-3c689c46c0d8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:31.702710 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-561e959a-2a97-4972-bbb8-3c689c46c0d8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:31.806560 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-eeccd4f8-2779-4918-a50a-89eadd50a929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:31.807804 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-eeccd4f8-2779-4918-a50a-89eadd50a929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:31.809687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=2 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:31.815390 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eeccd4f8-2779-4918-a50a-89eadd50a929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:31.815874 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eeccd4f8-2779-4918-a50a-89eadd50a929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:31.816309 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eeccd4f8-2779-4918-a50a-89eadd50a929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:31.817002 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eeccd4f8-2779-4918-a50a-89eadd50a929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:31.817456 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eeccd4f8-2779-4918-a50a-89eadd50a929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:31.817878 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eeccd4f8-2779-4918-a50a-89eadd50a929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:31.841246 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-561e959a-2a97-4972-bbb8-3c689c46c0d8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:31.850200 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-561e959a-2a97-4972-bbb8-3c689c46c0d8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1737 microversion: 2.1 time: 0.163055 Aug 17 07:30:31.850973 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 234/469] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:31 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:31.964488 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-eeccd4f8-2779-4918-a50a-89eadd50a929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:31.972709 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-eeccd4f8-2779-4918-a50a-89eadd50a929 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1682 microversion: 2.1 time: 0.170300 Aug 17 07:30:31.973271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 236/470] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:31 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:30:32.872664 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b019327c-6a1b-47b0-a552-d24d17ca887a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:32.873265 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-b019327c-6a1b-47b0-a552-d24d17ca887a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:32.881654 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b019327c-6a1b-47b0-a552-d24d17ca887a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:32.882168 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b019327c-6a1b-47b0-a552-d24d17ca887a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:32.882613 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b019327c-6a1b-47b0-a552-d24d17ca887a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:32.883348 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b019327c-6a1b-47b0-a552-d24d17ca887a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:32.883801 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b019327c-6a1b-47b0-a552-d24d17ca887a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:32.884229 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b019327c-6a1b-47b0-a552-d24d17ca887a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:32.994457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-0aca0a9c-2a22-49e1-b1f9-f3b2b484f326 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:32.995760 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-0aca0a9c-2a22-49e1-b1f9-f3b2b484f326 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:33.009742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0aca0a9c-2a22-49e1-b1f9-f3b2b484f326 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:33.010276 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0aca0a9c-2a22-49e1-b1f9-f3b2b484f326 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:33.010720 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0aca0a9c-2a22-49e1-b1f9-f3b2b484f326 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:33.011432 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0aca0a9c-2a22-49e1-b1f9-f3b2b484f326 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:33.012066 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0aca0a9c-2a22-49e1-b1f9-f3b2b484f326 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:33.012652 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0aca0a9c-2a22-49e1-b1f9-f3b2b484f326 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:33.076356 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-b019327c-6a1b-47b0-a552-d24d17ca887a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:33.093305 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b019327c-6a1b-47b0-a552-d24d17ca887a tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1737 microversion: 2.1 time: 0.225026 Aug 17 07:30:33.104843 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 235/471] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:32 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:33.110769 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-0aca0a9c-2a22-49e1-b1f9-f3b2b484f326 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:33.122822 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-0aca0a9c-2a22-49e1-b1f9-f3b2b484f326 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1615 microversion: 2.1 time: 0.132872 Aug 17 07:30:33.123592 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 237/472] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:32 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1615 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:33.221308 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9ea75552-4d24-44b5-ac46-f94eb8f987e4 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:33.221926 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9ea75552-4d24-44b5-ac46-f94eb8f987e4 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:33.228018 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ea75552-4d24-44b5-ac46-f94eb8f987e4 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:33.228507 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ea75552-4d24-44b5-ac46-f94eb8f987e4 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:33.228961 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ea75552-4d24-44b5-ac46-f94eb8f987e4 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:33.229655 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ea75552-4d24-44b5-ac46-f94eb8f987e4 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:33.230165 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ea75552-4d24-44b5-ac46-f94eb8f987e4 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:33.231729 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ea75552-4d24-44b5-ac46-f94eb8f987e4 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:33.401005 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-9ea75552-4d24-44b5-ac46-f94eb8f987e4 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:33.403866 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-f36535bc-aa3f-47dc-8121-8d0e19be1c06 req-f4e7205e-fd48-4505-8a2b-88aaa4706c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe690bb-f5a6-4080-aad0-4e79bf213d27", "name": "network-vif-deleted", "tag": "dbfd8859-14f2-4d83-923c-5789febe3ba4"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:33.411769 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9ea75552-4d24-44b5-ac46-f94eb8f987e4 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1593 microversion: 2.1 time: 0.195430 Aug 17 07:30:33.412815 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 236/473] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:33 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1593 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:33.426845 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-f36535bc-aa3f-47dc-8121-8d0e19be1c06 req-f4e7205e-fd48-4505-8a2b-88aaa4706c79 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:33.428066 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-f36535bc-aa3f-47dc-8121-8d0e19be1c06 req-f4e7205e-fd48-4505-8a2b-88aaa4706c79 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:33.428504 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-f36535bc-aa3f-47dc-8121-8d0e19be1c06 req-f4e7205e-fd48-4505-8a2b-88aaa4706c79 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:33.454141 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-f36535bc-aa3f-47dc-8121-8d0e19be1c06 req-f4e7205e-fd48-4505-8a2b-88aaa4706c79 service nova] Creating event network-vif-deleted:dbfd8859-14f2-4d83-923c-5789febe3ba4 for instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 on hv-cinder-85312 Aug 17 07:30:33.461237 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-f36535bc-aa3f-47dc-8121-8d0e19be1c06 req-f4e7205e-fd48-4505-8a2b-88aaa4706c79 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069412 Aug 17 07:30:33.461428 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 238/474] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:30:34.118823 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-547af0c9-45c3-492f-a935-9eca0b3ec85f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:34.119494 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-547af0c9-45c3-492f-a935-9eca0b3ec85f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:34.131725 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-547af0c9-45c3-492f-a935-9eca0b3ec85f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:34.137879 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-547af0c9-45c3-492f-a935-9eca0b3ec85f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:34.152564 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-547af0c9-45c3-492f-a935-9eca0b3ec85f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:34.152812 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-547af0c9-45c3-492f-a935-9eca0b3ec85f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:34.153674 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-547af0c9-45c3-492f-a935-9eca0b3ec85f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:34.154343 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-547af0c9-45c3-492f-a935-9eca0b3ec85f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:34.158333 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-f03a4f25-b5b3-4b03-bbef-abbe0d8c06b0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:34.159836 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-f03a4f25-b5b3-4b03-bbef-abbe0d8c06b0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:34.174979 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f03a4f25-b5b3-4b03-bbef-abbe0d8c06b0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:34.176861 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f03a4f25-b5b3-4b03-bbef-abbe0d8c06b0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:34.177543 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f03a4f25-b5b3-4b03-bbef-abbe0d8c06b0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:34.180681 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f03a4f25-b5b3-4b03-bbef-abbe0d8c06b0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:34.181378 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f03a4f25-b5b3-4b03-bbef-abbe0d8c06b0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:34.185196 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f03a4f25-b5b3-4b03-bbef-abbe0d8c06b0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:34.262762 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f03a4f25-b5b3-4b03-bbef-abbe0d8c06b0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:34.264260 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f03a4f25-b5b3-4b03-bbef-abbe0d8c06b0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:34.265322 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f03a4f25-b5b3-4b03-bbef-abbe0d8c06b0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:34.266396 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.objects.instance [None req-f03a4f25-b5b3-4b03-bbef-abbe0d8c06b0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lazy-loading 'fault' on Instance uuid ebe690bb-f5a6-4080-aad0-4e79bf213d27 {{(pid=120835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:30:34.344294 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-f03a4f25-b5b3-4b03-bbef-abbe0d8c06b0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:34.359740 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-f03a4f25-b5b3-4b03-bbef-abbe0d8c06b0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1332 microversion: 2.1 time: 0.217777 Aug 17 07:30:34.362193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 239/475] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:34 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1332 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:34.446865 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-547af0c9-45c3-492f-a935-9eca0b3ec85f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:34.458267 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-547af0c9-45c3-492f-a935-9eca0b3ec85f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1737 microversion: 2.1 time: 0.343486 Aug 17 07:30:34.459439 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 237/476] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:34 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1737 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:35.388358 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a795fc5f-e65c-4e4e-9a3f-a651042dd10a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:35.390695 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a795fc5f-e65c-4e4e-9a3f-a651042dd10a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:35.402281 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a795fc5f-e65c-4e4e-9a3f-a651042dd10a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:35.403058 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a795fc5f-e65c-4e4e-9a3f-a651042dd10a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:35.403678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a795fc5f-e65c-4e4e-9a3f-a651042dd10a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:35.404590 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a795fc5f-e65c-4e4e-9a3f-a651042dd10a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:35.405224 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a795fc5f-e65c-4e4e-9a3f-a651042dd10a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:35.405931 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a795fc5f-e65c-4e4e-9a3f-a651042dd10a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:35.475481 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a795fc5f-e65c-4e4e-9a3f-a651042dd10a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:35.482682 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-eae45a92-3c88-480e-93c7-ed08228371b5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:35.484097 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-eae45a92-3c88-480e-93c7-ed08228371b5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:35.489683 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a795fc5f-e65c-4e4e-9a3f-a651042dd10a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:35.490417 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a795fc5f-e65c-4e4e-9a3f-a651042dd10a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:35.491849 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.objects.instance [None req-a795fc5f-e65c-4e4e-9a3f-a651042dd10a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lazy-loading 'fault' on Instance uuid ebe690bb-f5a6-4080-aad0-4e79bf213d27 {{(pid=120835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:30:35.494844 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-eae45a92-3c88-480e-93c7-ed08228371b5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:35.496888 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-eae45a92-3c88-480e-93c7-ed08228371b5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:35.499177 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-eae45a92-3c88-480e-93c7-ed08228371b5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:35.502259 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-eae45a92-3c88-480e-93c7-ed08228371b5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:35.502808 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-eae45a92-3c88-480e-93c7-ed08228371b5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:35.503383 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-eae45a92-3c88-480e-93c7-ed08228371b5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:35.564348 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a795fc5f-e65c-4e4e-9a3f-a651042dd10a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:35.576504 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a795fc5f-e65c-4e4e-9a3f-a651042dd10a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 200 len: 1332 microversion: 2.1 time: 0.188995 Aug 17 07:30:35.577306 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 240/477] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:35 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 1332 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:35.716041 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-eae45a92-3c88-480e-93c7-ed08228371b5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:35.726043 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-eae45a92-3c88-480e-93c7-ed08228371b5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1737 microversion: 2.1 time: 0.247613 Aug 17 07:30:35.726971 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 238/478] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:35 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1737 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:30:35.969649 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-87c2d3a0-4d53-43d4-aeae-1fb122aa022c req-fd297ed8-7258-4dcc-9956-9578b4e155da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a37385c-cdcc-4d52-89c4-241744d2d17d", "tag": "fb3fc6d2-2e3d-4fa5-979a-023f68ad390f"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:35.989550 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-87c2d3a0-4d53-43d4-aeae-1fb122aa022c req-fd297ed8-7258-4dcc-9956-9578b4e155da service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:35.990607 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-87c2d3a0-4d53-43d4-aeae-1fb122aa022c req-fd297ed8-7258-4dcc-9956-9578b4e155da service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:35.990607 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-87c2d3a0-4d53-43d4-aeae-1fb122aa022c req-fd297ed8-7258-4dcc-9956-9578b4e155da service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:36.003457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-87c2d3a0-4d53-43d4-aeae-1fb122aa022c req-fd297ed8-7258-4dcc-9956-9578b4e155da service nova] Creating event network-changed:fb3fc6d2-2e3d-4fa5-979a-023f68ad390f for instance 4a37385c-cdcc-4d52-89c4-241744d2d17d on hv-cinder-85312 Aug 17 07:30:36.008548 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-87c2d3a0-4d53-43d4-aeae-1fb122aa022c req-fd297ed8-7258-4dcc-9956-9578b4e155da service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046408 Aug 17 07:30:36.009670 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 241/479] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:30:36.598763 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-00430a26-62ad-407e-b7bb-c0b36d95ca66 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:36.599920 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-00430a26-62ad-407e-b7bb-c0b36d95ca66 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:36.611659 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-00430a26-62ad-407e-b7bb-c0b36d95ca66 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:36.611659 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-00430a26-62ad-407e-b7bb-c0b36d95ca66 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:36.611659 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-00430a26-62ad-407e-b7bb-c0b36d95ca66 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:36.611659 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-00430a26-62ad-407e-b7bb-c0b36d95ca66 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:36.612316 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-00430a26-62ad-407e-b7bb-c0b36d95ca66 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:36.612316 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-00430a26-62ad-407e-b7bb-c0b36d95ca66 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:36.631541 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-00430a26-62ad-407e-b7bb-c0b36d95ca66 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] HTTP exception thrown: Instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 could not be found. Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-00430a26-62ad-407e-b7bb-c0b36d95ca66 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Request method failure captured: Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 HTTP/1.1 Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JhGMmtOHPQ5tXMBLT1ZWRDn92BoL8xS5HEV9kJ9w-VnlQw7GKIuWmct0Qgt_en_280xO3qINH5E37EeabHnDI9eZ1ASkmK0KnVQ204joQi6gbsZ95MMAexn68sEvntVaw9I7_UKoZlfQdjEqiEYm3qsshCMucpzh5z8w4kUhehd2Ow Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:30:36.633230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:30:36.634735 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}] Aug 17 07:30:36.634735 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:30:36.634735 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:30:36.634735 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:30:36.634735 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:30:36.634735 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:30:36.634735 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:30:36.634735 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: f8b0c96c80db4db4a477a1fa6c1fa4db Aug 17 07:30:36.634735 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:30:36.634735 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:30:36.634735 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 could not be found. Aug 17 07:30:36.634735 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': 'ebe690bb-f5a6-4080-aad0-4e79bf213d27'} Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 could not be found. Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:30:36.635641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:30:36.637099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:30:36.637099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:30:36.637099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:30:36.637099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:30:36.637099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:30:36.637099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:30:36.637099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:30:36.637099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 could not be found. Aug 17 07:30:36.637099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:30:36.637099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:30:36.637099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:30:36.637099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:30:36.637099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:30:36.637099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:30:36.637099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:30:36.637099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:30:36.637099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 could not be found. Aug 17 07:30:36.637099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:30:36.639282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-00430a26-62ad-407e-b7bb-c0b36d95ca66 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Returning 404 to user: Instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:30:36.639282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-00430a26-62ad-407e-b7bb-c0b36d95ca66 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 404 len: 111 microversion: 2.1 time: 0.040125 Aug 17 07:30:36.639282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 239/480] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:36 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:30:36.645401 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-34b683ad-b95a-444e-b38a-c01e2a10604c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '.version_select at 0x7f30ac3fdca0>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:36.705212 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-34b683ad-b95a-444e-b38a-c01e2a10604c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1694000622" status: 202 len: 0 microversion: 2.1 time: 0.064526 Aug 17 07:30:36.705850 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 242/481] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Aug 17 07:30:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1694000622 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:30:36.749212 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c709eef4-bd74-44c4-bcc7-e13e8b7a26aa tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:36.753059 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c709eef4-bd74-44c4-bcc7-e13e8b7a26aa tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:36.780585 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c709eef4-bd74-44c4-bcc7-e13e8b7a26aa tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:36.781348 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c709eef4-bd74-44c4-bcc7-e13e8b7a26aa tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:36.782114 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c709eef4-bd74-44c4-bcc7-e13e8b7a26aa tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:36.785570 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c709eef4-bd74-44c4-bcc7-e13e8b7a26aa tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:36.786227 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c709eef4-bd74-44c4-bcc7-e13e8b7a26aa tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:36.786851 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c709eef4-bd74-44c4-bcc7-e13e8b7a26aa tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:37.051079 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c709eef4-bd74-44c4-bcc7-e13e8b7a26aa tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:37.068973 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c709eef4-bd74-44c4-bcc7-e13e8b7a26aa tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1737 microversion: 2.1 time: 0.324975 Aug 17 07:30:37.069559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 240/482] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:36 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1737 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:37.367956 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-227c2452-944a-46e9-9e6d-bc99a36e8a23 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1820024349"}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:37.368617 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-227c2452-944a-46e9-9e6d-bc99a36e8a23 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:37.379424 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-227c2452-944a-46e9-9e6d-bc99a36e8a23 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:37.380180 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-227c2452-944a-46e9-9e6d-bc99a36e8a23 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:37.380777 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-227c2452-944a-46e9-9e6d-bc99a36e8a23 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:37.381658 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-227c2452-944a-46e9-9e6d-bc99a36e8a23 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:37.382311 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-227c2452-944a-46e9-9e6d-bc99a36e8a23 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:37.384825 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-227c2452-944a-46e9-9e6d-bc99a36e8a23 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:37.761702 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.network.security_group_api [None req-227c2452-944a-46e9-9e6d-bc99a36e8a23 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Adding security group f7068dd8-4afc-4dda-8a79-a14f2a356bec to port fb3fc6d2-2e3d-4fa5-979a-023f68ad390f Aug 17 07:30:38.093081 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b9da8929-5ab9-461d-b7e7-f10b2828837e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:38.094357 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-b9da8929-5ab9-461d-b7e7-f10b2828837e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:38.104534 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b9da8929-5ab9-461d-b7e7-f10b2828837e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:38.108018 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b9da8929-5ab9-461d-b7e7-f10b2828837e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:38.108660 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b9da8929-5ab9-461d-b7e7-f10b2828837e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:38.110241 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b9da8929-5ab9-461d-b7e7-f10b2828837e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:38.110897 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b9da8929-5ab9-461d-b7e7-f10b2828837e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:38.116195 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b9da8929-5ab9-461d-b7e7-f10b2828837e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:38.418310 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-b9da8929-5ab9-461d-b7e7-f10b2828837e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:38.426941 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b9da8929-5ab9-461d-b7e7-f10b2828837e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1717 microversion: 2.1 time: 0.340176 Aug 17 07:30:38.434134 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 241/483] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:38 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1717 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:38.434134 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-fb511281-2417-43fd-b8df-49819421069d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:38.434134 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-fb511281-2417-43fd-b8df-49819421069d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:38.440432 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fb511281-2417-43fd-b8df-49819421069d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:38.441133 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fb511281-2417-43fd-b8df-49819421069d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:38.441726 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fb511281-2417-43fd-b8df-49819421069d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:38.442642 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fb511281-2417-43fd-b8df-49819421069d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:38.443262 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fb511281-2417-43fd-b8df-49819421069d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:38.443844 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fb511281-2417-43fd-b8df-49819421069d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:38.544304 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-227c2452-944a-46e9-9e6d-bc99a36e8a23 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "POST /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/action" status: 202 len: 0 microversion: 2.1 time: 1.180436 Aug 17 07:30:38.544992 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 243/484] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 17 07:30:37 2022] POST /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/action => generated 0 bytes in 1182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:30:38.556145 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-87d6ba2d-100a-4354-b2a3-6f9f33de59b1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:38.556772 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-87d6ba2d-100a-4354-b2a3-6f9f33de59b1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:38.566643 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87d6ba2d-100a-4354-b2a3-6f9f33de59b1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:38.567331 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87d6ba2d-100a-4354-b2a3-6f9f33de59b1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:38.567926 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87d6ba2d-100a-4354-b2a3-6f9f33de59b1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:38.568799 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87d6ba2d-100a-4354-b2a3-6f9f33de59b1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:38.569471 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87d6ba2d-100a-4354-b2a3-6f9f33de59b1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:38.570081 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87d6ba2d-100a-4354-b2a3-6f9f33de59b1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:38.658741 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.objects.instance [None req-fb511281-2417-43fd-b8df-49819421069d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lazy-loading 'services' on Instance uuid 15365fa0-3501-49cd-a3d5-9ac53d13169f {{(pid=120834) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:30:38.772585 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-87d6ba2d-100a-4354-b2a3-6f9f33de59b1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:38.789039 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-87d6ba2d-100a-4354-b2a3-6f9f33de59b1 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1758 microversion: 2.1 time: 0.239879 Aug 17 07:30:38.806747 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 244/485] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:38 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1758 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:38.812606 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-44fa5910-faa1-4ace-8711-ed616cf971dc req-7e18889e-7d9f-4222-8e29-4aa3e228cb64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a37385c-cdcc-4d52-89c4-241744d2d17d", "tag": "fb3fc6d2-2e3d-4fa5-979a-023f68ad390f"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:38.833266 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-fb511281-2417-43fd-b8df-49819421069d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "DELETE /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f/os-volume_attachments/d50b1d8d-0e26-44b9-8b24-0844730aa827" status: 202 len: 0 microversion: 2.1 time: 0.403190 Aug 17 07:30:38.834251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 242/486] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 17 07:30:38 2022] DELETE /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f/os-volume_attachments/d50b1d8d-0e26-44b9-8b24-0844730aa827 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:30:38.839263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-44fa5910-faa1-4ace-8711-ed616cf971dc req-7e18889e-7d9f-4222-8e29-4aa3e228cb64 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:38.839742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-44fa5910-faa1-4ace-8711-ed616cf971dc req-7e18889e-7d9f-4222-8e29-4aa3e228cb64 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:38.840178 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-44fa5910-faa1-4ace-8711-ed616cf971dc req-7e18889e-7d9f-4222-8e29-4aa3e228cb64 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:38.841300 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-2b8a8b2f-0c25-4668-8274-c75d57e8c071 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:38.842178 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-2b8a8b2f-0c25-4668-8274-c75d57e8c071 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:38.850217 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2b8a8b2f-0c25-4668-8274-c75d57e8c071 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:38.851021 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2b8a8b2f-0c25-4668-8274-c75d57e8c071 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:38.851689 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2b8a8b2f-0c25-4668-8274-c75d57e8c071 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:38.852628 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2b8a8b2f-0c25-4668-8274-c75d57e8c071 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:38.853835 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2b8a8b2f-0c25-4668-8274-c75d57e8c071 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:38.854538 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2b8a8b2f-0c25-4668-8274-c75d57e8c071 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:38.877201 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-44fa5910-faa1-4ace-8711-ed616cf971dc req-7e18889e-7d9f-4222-8e29-4aa3e228cb64 service nova] Creating event network-changed:fb3fc6d2-2e3d-4fa5-979a-023f68ad390f for instance 4a37385c-cdcc-4d52-89c4-241744d2d17d on hv-cinder-85312 Aug 17 07:30:38.883570 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-44fa5910-faa1-4ace-8711-ed616cf971dc req-7e18889e-7d9f-4222-8e29-4aa3e228cb64 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075206 Aug 17 07:30:38.884659 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 245/487] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:30:38.891079 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3769793a-7968-4d66-a58f-5487ea843d18 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:38.893503 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-3769793a-7968-4d66-a58f-5487ea843d18 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:38.914550 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3769793a-7968-4d66-a58f-5487ea843d18 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:38.915885 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3769793a-7968-4d66-a58f-5487ea843d18 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:38.917775 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3769793a-7968-4d66-a58f-5487ea843d18 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:38.923239 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3769793a-7968-4d66-a58f-5487ea843d18 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:38.924988 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3769793a-7968-4d66-a58f-5487ea843d18 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:38.925614 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3769793a-7968-4d66-a58f-5487ea843d18 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:38.966989 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:38.973186 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-3769793a-7968-4d66-a58f-5487ea843d18 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087188 Aug 17 07:30:38.978164 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 246/488] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:30:38 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:30:39.029792 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-2b8a8b2f-0c25-4668-8274-c75d57e8c071 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] HTTP exception thrown: Cannot 'detach_volume' instance 1f58c6a6-fa9c-4795-97c2-525c1510124b while it is in vm_state rescued Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-2b8a8b2f-0c25-4668-8274-c75d57e8c071 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Request method failure captured: Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: DELETE /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/os-volume_attachments/9254b136-155d-4ea8-b1a1-399209c81656 HTTP/1.1 Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JhF5-28creqGjzJ0w0FxfPIBrCoALS6gQ2HtbOL3lJ0gLFx-dck1PDzbYwQcX2lNejuqyWG7p1bT6QmRlBuXmZgoEKIvihIfqvjPN4OpTNbaW9hBDO8GuDNGgy1UgRxXva9ZNQGdNRx4F3DMiBLL_i8w2oipQ2U63hj19PBJYA7bhU Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 177d0707c9d1494abc77c714e31fa15f Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-901876947 Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:30:39.031712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:30:39.033798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_177d0707c9d1494abc77c714e31fa15f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/177d0707c9d1494abc77c714e31fa15f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/177d0707c9d1494abc77c714e31fa15f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/177d0707c9d1494abc77c714e31fa15f"}]}] Aug 17 07:30:39.033798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-ServerRescueNegativeTestJSON-901876947 Aug 17 07:30:39.033798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 177d0707c9d1494abc77c714e31fa15f Aug 17 07:30:39.033798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-901876947 Aug 17 07:30:39.033798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-ServerRescueNegativeTestJSON-901876947-project Aug 17 07:30:39.033798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:30:39.033798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:30:39.033798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: be489ecec19847829df7c4488986373e Aug 17 07:30:39.033798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-ServerRescueNegativeTestJSON-901876947-project Aug 17 07:30:39.033798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:30:39.033798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Cannot 'detach_volume' instance 1f58c6a6-fa9c-4795-97c2-525c1510124b while it is in vm_state rescued Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'server_id': '1f58c6a6-fa9c-4795-97c2-525c1510124b', 'id': '9254b136-155d-4ea8-b1a1-399209c81656'} Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1f58c6a6-fa9c-4795-97c2-525c1510124b in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:30:39.035016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:30:39.036486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 17 07:30:39.036486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 17 07:30:39.036486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 17 07:30:39.036486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 17 07:30:39.036486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1f58c6a6-fa9c-4795-97c2-525c1510124b while it is in vm_state rescued Aug 17 07:30:39.036486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:30:39.036486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:30:39.036486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:30:39.036486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:30:39.036486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:30:39.036486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:30:39.036486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:30:39.036486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:30:39.036486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1f58c6a6-fa9c-4795-97c2-525c1510124b while it is in vm_state rescued Aug 17 07:30:39.036486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:30:39.036486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-2b8a8b2f-0c25-4668-8274-c75d57e8c071 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Returning 409 to user: Cannot 'detach_volume' instance 1f58c6a6-fa9c-4795-97c2-525c1510124b while it is in vm_state rescued {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:30:39.038729 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-2b8a8b2f-0c25-4668-8274-c75d57e8c071 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/os-volume_attachments/9254b136-155d-4ea8-b1a1-399209c81656" status: 409 len: 152 microversion: 2.1 time: 0.202572 Aug 17 07:30:39.039554 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 243/489] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 17 07:30:38 2022] DELETE /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/os-volume_attachments/9254b136-155d-4ea8-b1a1-399209c81656 => generated 152 bytes in 205 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 17 07:30:39.047761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-31bd1a8a-0522-43d1-a931-7aaf1718419c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:39.049468 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-31bd1a8a-0522-43d1-a931-7aaf1718419c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:39.058677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-31bd1a8a-0522-43d1-a931-7aaf1718419c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:39.059721 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-31bd1a8a-0522-43d1-a931-7aaf1718419c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:39.060334 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-31bd1a8a-0522-43d1-a931-7aaf1718419c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:39.061220 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-31bd1a8a-0522-43d1-a931-7aaf1718419c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:39.061831 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-31bd1a8a-0522-43d1-a931-7aaf1718419c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:39.062984 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-31bd1a8a-0522-43d1-a931-7aaf1718419c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:39.149432 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-31bd1a8a-0522-43d1-a931-7aaf1718419c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "POST /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/action" status: 202 len: 0 microversion: 2.1 time: 0.105024 Aug 17 07:30:39.150286 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 247/490] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 17 07:30:39 2022] POST /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:30:39.158634 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-01f13915-58de-47ea-a3c9-8a06a14f61b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:39.159707 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-01f13915-58de-47ea-a3c9-8a06a14f61b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:39.166512 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-01f13915-58de-47ea-a3c9-8a06a14f61b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:39.167225 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-01f13915-58de-47ea-a3c9-8a06a14f61b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:39.167875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-01f13915-58de-47ea-a3c9-8a06a14f61b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:39.168811 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-01f13915-58de-47ea-a3c9-8a06a14f61b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:39.169364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-01f13915-58de-47ea-a3c9-8a06a14f61b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:39.169888 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-01f13915-58de-47ea-a3c9-8a06a14f61b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:39.174966 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:39.309812 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-01f13915-58de-47ea-a3c9-8a06a14f61b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:39.318342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-01f13915-58de-47ea-a3c9-8a06a14f61b8 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1725 microversion: 2.1 time: 0.164003 Aug 17 07:30:39.318832 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 244/491] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:39 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:39.986863 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-822b8717-f29a-4f08-bc0b-1b496b5bf8f6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:39.989084 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-822b8717-f29a-4f08-bc0b-1b496b5bf8f6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:39.995824 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-822b8717-f29a-4f08-bc0b-1b496b5bf8f6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:39.996295 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-822b8717-f29a-4f08-bc0b-1b496b5bf8f6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:39.996726 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-822b8717-f29a-4f08-bc0b-1b496b5bf8f6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:39.997408 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-822b8717-f29a-4f08-bc0b-1b496b5bf8f6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:39.997853 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-822b8717-f29a-4f08-bc0b-1b496b5bf8f6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:39.998293 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-822b8717-f29a-4f08-bc0b-1b496b5bf8f6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:40.026909 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-822b8717-f29a-4f08-bc0b-1b496b5bf8f6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044969 Aug 17 07:30:40.027461 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 248/492] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:30:39 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:30:40.339720 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-5216d564-7ea7-42da-a19e-6d277290dcd3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:40.340429 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-5216d564-7ea7-42da-a19e-6d277290dcd3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:40.347531 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5216d564-7ea7-42da-a19e-6d277290dcd3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:40.347984 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5216d564-7ea7-42da-a19e-6d277290dcd3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:40.348419 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5216d564-7ea7-42da-a19e-6d277290dcd3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:40.349153 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5216d564-7ea7-42da-a19e-6d277290dcd3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:40.349605 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5216d564-7ea7-42da-a19e-6d277290dcd3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:40.350063 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5216d564-7ea7-42da-a19e-6d277290dcd3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:40.487409 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-5216d564-7ea7-42da-a19e-6d277290dcd3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:40.495573 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-5216d564-7ea7-42da-a19e-6d277290dcd3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1725 microversion: 2.1 time: 0.159659 Aug 17 07:30:40.496126 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 245/493] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:40 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:41.039533 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-59ce45c6-a65f-4dc6-8829-98ea92a41ea1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:41.041647 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-59ce45c6-a65f-4dc6-8829-98ea92a41ea1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:41.048034 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-59ce45c6-a65f-4dc6-8829-98ea92a41ea1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:41.049005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-59ce45c6-a65f-4dc6-8829-98ea92a41ea1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:41.049440 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-59ce45c6-a65f-4dc6-8829-98ea92a41ea1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:41.050163 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-59ce45c6-a65f-4dc6-8829-98ea92a41ea1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:41.050617 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-59ce45c6-a65f-4dc6-8829-98ea92a41ea1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:41.051044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-59ce45c6-a65f-4dc6-8829-98ea92a41ea1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:41.079103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-59ce45c6-a65f-4dc6-8829-98ea92a41ea1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043592 Aug 17 07:30:41.079649 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 249/494] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:30:41 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 07:30:41.140941 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-d8ed89a6-546a-4308-b729-e950beb5c154 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:41.141425 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-d8ed89a6-546a-4308-b729-e950beb5c154 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:41.147328 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8ed89a6-546a-4308-b729-e950beb5c154 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:41.147796 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8ed89a6-546a-4308-b729-e950beb5c154 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:41.148222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8ed89a6-546a-4308-b729-e950beb5c154 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:41.148893 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8ed89a6-546a-4308-b729-e950beb5c154 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:41.149335 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8ed89a6-546a-4308-b729-e950beb5c154 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:41.149748 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8ed89a6-546a-4308-b729-e950beb5c154 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:41.172882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-d8ed89a6-546a-4308-b729-e950beb5c154 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Going to try to terminate instance {{(pid=120834) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:30:41.245004 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-d8ed89a6-546a-4308-b729-e950beb5c154 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "DELETE /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 204 len: 0 microversion: 2.1 time: 0.107579 Aug 17 07:30:41.245569 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 246/495] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:30:41 2022] DELETE /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:30:41.253515 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-956f5f3c-0ce8-4c91-814f-c42c1e5baa38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:41.254154 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-956f5f3c-0ce8-4c91-814f-c42c1e5baa38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:41.259860 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-956f5f3c-0ce8-4c91-814f-c42c1e5baa38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:41.260328 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-956f5f3c-0ce8-4c91-814f-c42c1e5baa38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:41.260755 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-956f5f3c-0ce8-4c91-814f-c42c1e5baa38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:41.261425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-956f5f3c-0ce8-4c91-814f-c42c1e5baa38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:41.261870 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-956f5f3c-0ce8-4c91-814f-c42c1e5baa38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:41.262309 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-956f5f3c-0ce8-4c91-814f-c42c1e5baa38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:41.391292 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-956f5f3c-0ce8-4c91-814f-c42c1e5baa38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:41.399582 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-956f5f3c-0ce8-4c91-814f-c42c1e5baa38 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1679 microversion: 2.1 time: 0.149680 Aug 17 07:30:41.400148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 250/496] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:41 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:30:41.517636 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-5bd34e7c-46b7-4bcd-87f4-accb65c0fd73 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:41.518362 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-5bd34e7c-46b7-4bcd-87f4-accb65c0fd73 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:41.524524 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5bd34e7c-46b7-4bcd-87f4-accb65c0fd73 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:41.524994 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5bd34e7c-46b7-4bcd-87f4-accb65c0fd73 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:41.525419 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5bd34e7c-46b7-4bcd-87f4-accb65c0fd73 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:41.526135 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5bd34e7c-46b7-4bcd-87f4-accb65c0fd73 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:41.526579 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5bd34e7c-46b7-4bcd-87f4-accb65c0fd73 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:41.526995 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5bd34e7c-46b7-4bcd-87f4-accb65c0fd73 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:41.653807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-5bd34e7c-46b7-4bcd-87f4-accb65c0fd73 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:41.661596 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-5bd34e7c-46b7-4bcd-87f4-accb65c0fd73 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1725 microversion: 2.1 time: 0.148832 Aug 17 07:30:41.662173 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 247/497] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:41 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:42.420519 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3566b248-32b0-4501-9894-317b05f861dc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:42.421136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-3566b248-32b0-4501-9894-317b05f861dc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:42.427705 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3566b248-32b0-4501-9894-317b05f861dc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:42.428181 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3566b248-32b0-4501-9894-317b05f861dc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:42.428615 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3566b248-32b0-4501-9894-317b05f861dc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:42.429420 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3566b248-32b0-4501-9894-317b05f861dc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:42.429879 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3566b248-32b0-4501-9894-317b05f861dc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:42.430402 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3566b248-32b0-4501-9894-317b05f861dc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:42.560784 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3566b248-32b0-4501-9894-317b05f861dc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:42.568072 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-3566b248-32b0-4501-9894-317b05f861dc tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1679 microversion: 2.1 time: 0.151499 Aug 17 07:30:42.568631 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 251/498] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:42 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:42.683488 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-55555e35-e3a9-483e-97fc-8508fccc6e69 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:42.684022 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-55555e35-e3a9-483e-97fc-8508fccc6e69 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:42.690740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-55555e35-e3a9-483e-97fc-8508fccc6e69 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:42.691357 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-55555e35-e3a9-483e-97fc-8508fccc6e69 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:42.691791 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-55555e35-e3a9-483e-97fc-8508fccc6e69 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:42.692527 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-55555e35-e3a9-483e-97fc-8508fccc6e69 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:42.693206 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-55555e35-e3a9-483e-97fc-8508fccc6e69 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:42.693657 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-55555e35-e3a9-483e-97fc-8508fccc6e69 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:42.820519 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-55555e35-e3a9-483e-97fc-8508fccc6e69 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:42.828381 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-55555e35-e3a9-483e-97fc-8508fccc6e69 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1725 microversion: 2.1 time: 0.148919 Aug 17 07:30:42.828940 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 248/499] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:42 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:43.588639 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3b718722-c363-4b27-8b48-d7fe893666b5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:43.589244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-3b718722-c363-4b27-8b48-d7fe893666b5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:43.596109 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3b718722-c363-4b27-8b48-d7fe893666b5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:43.596577 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3b718722-c363-4b27-8b48-d7fe893666b5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:43.597004 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3b718722-c363-4b27-8b48-d7fe893666b5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:43.597677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3b718722-c363-4b27-8b48-d7fe893666b5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:43.598145 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3b718722-c363-4b27-8b48-d7fe893666b5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:43.598565 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3b718722-c363-4b27-8b48-d7fe893666b5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:43.728284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3b718722-c363-4b27-8b48-d7fe893666b5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:43.736456 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-3b718722-c363-4b27-8b48-d7fe893666b5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1679 microversion: 2.1 time: 0.150981 Aug 17 07:30:43.737023 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 252/500] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:43 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:43.850507 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-363b2f0d-f396-4c87-849f-6b6621e44da3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:43.851180 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-363b2f0d-f396-4c87-849f-6b6621e44da3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:43.857600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-363b2f0d-f396-4c87-849f-6b6621e44da3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:43.858112 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-363b2f0d-f396-4c87-849f-6b6621e44da3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:43.858550 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-363b2f0d-f396-4c87-849f-6b6621e44da3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:43.859255 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-363b2f0d-f396-4c87-849f-6b6621e44da3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:43.860066 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-363b2f0d-f396-4c87-849f-6b6621e44da3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:43.860496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-363b2f0d-f396-4c87-849f-6b6621e44da3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:43.991230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-363b2f0d-f396-4c87-849f-6b6621e44da3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:44.000343 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-363b2f0d-f396-4c87-849f-6b6621e44da3 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1725 microversion: 2.1 time: 0.153614 Aug 17 07:30:44.000929 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 249/501] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:43 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:44.757171 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-bcc4939f-e63e-4e28-8107-f2c2e03aaa29 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:44.757776 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-bcc4939f-e63e-4e28-8107-f2c2e03aaa29 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:44.764084 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bcc4939f-e63e-4e28-8107-f2c2e03aaa29 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:44.764555 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bcc4939f-e63e-4e28-8107-f2c2e03aaa29 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:44.764981 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bcc4939f-e63e-4e28-8107-f2c2e03aaa29 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:44.765690 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bcc4939f-e63e-4e28-8107-f2c2e03aaa29 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:44.766235 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bcc4939f-e63e-4e28-8107-f2c2e03aaa29 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:44.766657 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bcc4939f-e63e-4e28-8107-f2c2e03aaa29 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:44.828890 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-80ae9c3e-2b24-4136-b593-7441228beed7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:44.829414 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-80ae9c3e-2b24-4136-b593-7441228beed7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:44.835278 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-80ae9c3e-2b24-4136-b593-7441228beed7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:44.836135 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-80ae9c3e-2b24-4136-b593-7441228beed7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:44.836254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-80ae9c3e-2b24-4136-b593-7441228beed7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:44.836843 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-80ae9c3e-2b24-4136-b593-7441228beed7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:44.837285 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-80ae9c3e-2b24-4136-b593-7441228beed7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:44.837767 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-80ae9c3e-2b24-4136-b593-7441228beed7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:44.903805 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-bcc4939f-e63e-4e28-8107-f2c2e03aaa29 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:44.913533 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-bcc4939f-e63e-4e28-8107-f2c2e03aaa29 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1679 microversion: 2.1 time: 0.160079 Aug 17 07:30:44.914203 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 253/502] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:44 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:44.919876 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.objects.instance [None req-80ae9c3e-2b24-4136-b593-7441228beed7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lazy-loading 'services' on Instance uuid 84d1495a-563e-4c4f-ba8c-1fa046813a22 {{(pid=120834) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:30:44.997550 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-80ae9c3e-2b24-4136-b593-7441228beed7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "DELETE /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22/os-volume_attachments/2e321076-d259-485a-a13f-a83e2045a2f0" status: 202 len: 0 microversion: 2.1 time: 0.171710 Aug 17 07:30:44.997550 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 250/503] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 17 07:30:44 2022] DELETE /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22/os-volume_attachments/2e321076-d259-485a-a13f-a83e2045a2f0 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 07:30:45.023226 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2f3f0e35-5e64-4e5b-adfe-01d7313f82a5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:45.026821 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-2f3f0e35-5e64-4e5b-adfe-01d7313f82a5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:45.034096 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2f3f0e35-5e64-4e5b-adfe-01d7313f82a5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:45.034665 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2f3f0e35-5e64-4e5b-adfe-01d7313f82a5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:45.035201 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2f3f0e35-5e64-4e5b-adfe-01d7313f82a5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:45.036000 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2f3f0e35-5e64-4e5b-adfe-01d7313f82a5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:45.036524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2f3f0e35-5e64-4e5b-adfe-01d7313f82a5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:45.037015 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2f3f0e35-5e64-4e5b-adfe-01d7313f82a5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:45.174353 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2f3f0e35-5e64-4e5b-adfe-01d7313f82a5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:45.182549 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-2f3f0e35-5e64-4e5b-adfe-01d7313f82a5 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1731 microversion: 2.1 time: 0.163817 Aug 17 07:30:45.183153 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 254/504] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:45 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:45.203447 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-382681a2-071a-4285-9cbc-e8a6d6a6579c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:45.204101 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-382681a2-071a-4285-9cbc-e8a6d6a6579c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:45.210255 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-382681a2-071a-4285-9cbc-e8a6d6a6579c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:45.210730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-382681a2-071a-4285-9cbc-e8a6d6a6579c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:45.211157 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-382681a2-071a-4285-9cbc-e8a6d6a6579c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:45.211841 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-382681a2-071a-4285-9cbc-e8a6d6a6579c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:45.212280 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-382681a2-071a-4285-9cbc-e8a6d6a6579c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:45.212699 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-382681a2-071a-4285-9cbc-e8a6d6a6579c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:45.293397 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-382681a2-071a-4285-9cbc-e8a6d6a6579c tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094115 Aug 17 07:30:45.293999 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 251/505] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 17 07:30:45 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:30:45.536545 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-df12f7e1-9670-4e59-8a0b-0e7a76474179 req-786edb63-4ac7-4ea4-9c02-01779c1d14d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15365fa0-3501-49cd-a3d5-9ac53d13169f", "name": "network-vif-deleted", "tag": "b2367014-b108-400d-a29f-670f07d2bad0"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:45.546761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-df12f7e1-9670-4e59-8a0b-0e7a76474179 req-786edb63-4ac7-4ea4-9c02-01779c1d14d0 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:45.547571 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-df12f7e1-9670-4e59-8a0b-0e7a76474179 req-786edb63-4ac7-4ea4-9c02-01779c1d14d0 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:45.558389 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-df12f7e1-9670-4e59-8a0b-0e7a76474179 req-786edb63-4ac7-4ea4-9c02-01779c1d14d0 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:45.575859 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-df12f7e1-9670-4e59-8a0b-0e7a76474179 req-786edb63-4ac7-4ea4-9c02-01779c1d14d0 service nova] Creating event network-vif-deleted:b2367014-b108-400d-a29f-670f07d2bad0 for instance 15365fa0-3501-49cd-a3d5-9ac53d13169f on hv-cinder-85312 Aug 17 07:30:45.584486 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-df12f7e1-9670-4e59-8a0b-0e7a76474179 req-786edb63-4ac7-4ea4-9c02-01779c1d14d0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052337 Aug 17 07:30:45.585773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 255/506] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:30:45.935878 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b2f93c35-adf3-4f94-993d-1bf6c045e15c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:45.936622 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-b2f93c35-adf3-4f94-993d-1bf6c045e15c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:45.943146 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b2f93c35-adf3-4f94-993d-1bf6c045e15c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:45.943639 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b2f93c35-adf3-4f94-993d-1bf6c045e15c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:45.944076 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b2f93c35-adf3-4f94-993d-1bf6c045e15c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:45.945102 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b2f93c35-adf3-4f94-993d-1bf6c045e15c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:45.945715 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b2f93c35-adf3-4f94-993d-1bf6c045e15c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:45.946347 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b2f93c35-adf3-4f94-993d-1bf6c045e15c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:45.979351 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b2f93c35-adf3-4f94-993d-1bf6c045e15c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:45.980101 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b2f93c35-adf3-4f94-993d-1bf6c045e15c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:45.980533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b2f93c35-adf3-4f94-993d-1bf6c045e15c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:45.981138 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.objects.instance [None req-b2f93c35-adf3-4f94-993d-1bf6c045e15c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lazy-loading 'fault' on Instance uuid 15365fa0-3501-49cd-a3d5-9ac53d13169f {{(pid=120834) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:30:46.060297 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-b2f93c35-adf3-4f94-993d-1bf6c045e15c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:46.068604 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b2f93c35-adf3-4f94-993d-1bf6c045e15c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 200 len: 1330 microversion: 2.1 time: 0.137208 Aug 17 07:30:46.082625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 252/507] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:45 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 1330 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:46.163711 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9c134520-6ca1-4c8b-af87-915fc02e197b tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:46.172307 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9c134520-6ca1-4c8b-af87-915fc02e197b tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:46.172887 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9c134520-6ca1-4c8b-af87-915fc02e197b tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:46.173391 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9c134520-6ca1-4c8b-af87-915fc02e197b tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:46.236773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-9c134520-6ca1-4c8b-af87-915fc02e197b tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Going to try to stop instance {{(pid=120835) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 17 07:30:46.312176 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-9c134520-6ca1-4c8b-af87-915fc02e197b tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "POST /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22/action" status: 202 len: 0 microversion: 2.1 time: 0.154511 Aug 17 07:30:46.321767 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9fbedb37-175b-45ba-8ef8-b9158f4f5eec tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:46.322749 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9fbedb37-175b-45ba-8ef8-b9158f4f5eec tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:46.326734 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 256/508] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 17 07:30:46 2022] POST /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:30:46.334273 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9fbedb37-175b-45ba-8ef8-b9158f4f5eec tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:46.335831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9fbedb37-175b-45ba-8ef8-b9158f4f5eec tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:46.336510 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9fbedb37-175b-45ba-8ef8-b9158f4f5eec tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:46.337295 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9fbedb37-175b-45ba-8ef8-b9158f4f5eec tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:46.338024 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9fbedb37-175b-45ba-8ef8-b9158f4f5eec tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:46.338681 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9fbedb37-175b-45ba-8ef8-b9158f4f5eec tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:46.359176 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-081895a4-6d42-47ea-9541-4ddc46da12ce req-03fb94d9-b1a7-457d-9af2-88d90debd4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f58c6a6-fa9c-4795-97c2-525c1510124b", "tag": "0799a736-86ba-40d5-8200-f99f2281e899"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:46.393019 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-081895a4-6d42-47ea-9541-4ddc46da12ce req-03fb94d9-b1a7-457d-9af2-88d90debd4a7 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:46.401194 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-081895a4-6d42-47ea-9541-4ddc46da12ce req-03fb94d9-b1a7-457d-9af2-88d90debd4a7 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:46.409144 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-081895a4-6d42-47ea-9541-4ddc46da12ce req-03fb94d9-b1a7-457d-9af2-88d90debd4a7 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:46.432142 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-081895a4-6d42-47ea-9541-4ddc46da12ce req-03fb94d9-b1a7-457d-9af2-88d90debd4a7 service nova] Creating event network-changed:0799a736-86ba-40d5-8200-f99f2281e899 for instance 1f58c6a6-fa9c-4795-97c2-525c1510124b on hv-cinder-85312 Aug 17 07:30:46.438173 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-081895a4-6d42-47ea-9541-4ddc46da12ce req-03fb94d9-b1a7-457d-9af2-88d90debd4a7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084498 Aug 17 07:30:46.438954 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 257/509] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:30:46.529617 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-9fbedb37-175b-45ba-8ef8-b9158f4f5eec tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:46.543068 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9fbedb37-175b-45ba-8ef8-b9158f4f5eec tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1678 microversion: 2.1 time: 0.225049 Aug 17 07:30:46.546050 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 253/510] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:46 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1678 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:30:47.089600 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9a5e10c8-fc6a-432f-811c-1d4657904f12 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:47.090642 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-9a5e10c8-fc6a-432f-811c-1d4657904f12 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:47.101803 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9a5e10c8-fc6a-432f-811c-1d4657904f12 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:47.102389 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9a5e10c8-fc6a-432f-811c-1d4657904f12 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:47.102816 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9a5e10c8-fc6a-432f-811c-1d4657904f12 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:47.103556 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9a5e10c8-fc6a-432f-811c-1d4657904f12 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:47.104041 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9a5e10c8-fc6a-432f-811c-1d4657904f12 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:47.104488 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9a5e10c8-fc6a-432f-811c-1d4657904f12 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:47.119231 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-9a5e10c8-fc6a-432f-811c-1d4657904f12 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] HTTP exception thrown: Instance 15365fa0-3501-49cd-a3d5-9ac53d13169f could not be found. Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9a5e10c8-fc6a-432f-811c-1d4657904f12 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Request method failure captured: Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f HTTP/1.1 Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JhGMmtOHPQ5tXMBLT1ZWRDn92BoL8xS5HEV9kJ9w-VnlQw7GKIuWmct0Qgt_en_280xO3qINH5E37EeabHnDI9eZ1ASkmK0KnVQ204joQi6gbsZ95MMAexn68sEvntVaw9I7_UKoZlfQdjEqiEYm3qsshCMucpzh5z8w4kUhehd2Ow Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:30:47.120852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:30:47.122400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}] Aug 17 07:30:47.122400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:30:47.122400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:30:47.122400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:30:47.122400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:30:47.122400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:30:47.122400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:30:47.122400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: f8b0c96c80db4db4a477a1fa6c1fa4db Aug 17 07:30:47.122400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:30:47.122400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:30:47.122400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance 15365fa0-3501-49cd-a3d5-9ac53d13169f could not be found. Aug 17 07:30:47.122400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': '15365fa0-3501-49cd-a3d5-9ac53d13169f'} Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15365fa0-3501-49cd-a3d5-9ac53d13169f could not be found. Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:30:47.123268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:30:47.124687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:30:47.124687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:30:47.124687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:30:47.124687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:30:47.124687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:30:47.124687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:30:47.124687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:30:47.124687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15365fa0-3501-49cd-a3d5-9ac53d13169f could not be found. Aug 17 07:30:47.124687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:30:47.124687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:30:47.124687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:30:47.124687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:30:47.124687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:30:47.124687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:30:47.124687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:30:47.124687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:30:47.124687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15365fa0-3501-49cd-a3d5-9ac53d13169f could not be found. Aug 17 07:30:47.124687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:30:47.126459 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9a5e10c8-fc6a-432f-811c-1d4657904f12 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Returning 404 to user: Instance 15365fa0-3501-49cd-a3d5-9ac53d13169f could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:30:47.126459 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-9a5e10c8-fc6a-432f-811c-1d4657904f12 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 404 len: 111 microversion: 2.1 time: 0.037185 Aug 17 07:30:47.126459 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 258/511] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:47 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:30:47.135617 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-84c2f0a9-9698-4eaf-bde0-05d1f02ceac0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '.version_select at 0x7f30ac3d4af0>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:47.160661 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-84c2f0a9-9698-4eaf-bde0-05d1f02ceac0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-99949283" status: 202 len: 0 microversion: 2.1 time: 0.028779 Aug 17 07:30:47.161525 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 254/512] 10.222.0.45 () {58 vars in 1215 bytes} [Wed Aug 17 07:30:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-99949283 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:30:47.565184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-fff755ea-85a6-4c94-9730-cc5bef2b6ac1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:47.566745 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-fff755ea-85a6-4c94-9730-cc5bef2b6ac1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:47.572745 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fff755ea-85a6-4c94-9730-cc5bef2b6ac1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:47.573225 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fff755ea-85a6-4c94-9730-cc5bef2b6ac1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:47.573659 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fff755ea-85a6-4c94-9730-cc5bef2b6ac1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:47.574374 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fff755ea-85a6-4c94-9730-cc5bef2b6ac1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:47.574825 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fff755ea-85a6-4c94-9730-cc5bef2b6ac1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:47.575250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fff755ea-85a6-4c94-9730-cc5bef2b6ac1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:47.814794 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-fff755ea-85a6-4c94-9730-cc5bef2b6ac1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:47.822470 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-fff755ea-85a6-4c94-9730-cc5bef2b6ac1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1678 microversion: 2.1 time: 0.261747 Aug 17 07:30:47.823039 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 259/513] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:47 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1678 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:48.081948 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7894db1c-3303-4024-8e8e-ad0eae930da0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Action: 'create', calling method: .version_select at 0x7f30ac288ca0>, body: {"keypair": {"name": "tempest-keypair-1020590318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrP5w29GGeu9kohSEHbYCxNDWIA9dX0j6HDvoYmLUsjMwj+5o3KlICI/3cyrBeDRolcBaJ/EOjwz043q3lRPTNGrHu69jntpPZZcbWjlF7ed3xfRtn1N52e+zwjq3MyjQ=="}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:48.097535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-7894db1c-3303-4024-8e8e-ad0eae930da0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Getting quotas for project 99d9a3fa9369495ab6d8da88f3d9dbd5. Resources: {'key_pairs'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:30:48.101374 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-7894db1c-3303-4024-8e8e-ad0eae930da0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Getting quotas for user f8b0c96c80db4db4a477a1fa6c1fa4db and project 99d9a3fa9369495ab6d8da88f3d9dbd5. Resources: {'key_pairs'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:30:48.122305 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-7894db1c-3303-4024-8e8e-ad0eae930da0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044799 Aug 17 07:30:48.122890 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 255/514] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 17 07:30:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:30:48.539707 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-dd5470d8-9d2a-4c8b-9d53-f293078d02ce req-ac78b0c4-13ed-4e2c-b7bb-2d0a8659d199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f58c6a6-fa9c-4795-97c2-525c1510124b", "tag": "0799a736-86ba-40d5-8200-f99f2281e899"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:48.549632 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-dd5470d8-9d2a-4c8b-9d53-f293078d02ce req-ac78b0c4-13ed-4e2c-b7bb-2d0a8659d199 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:48.550142 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-dd5470d8-9d2a-4c8b-9d53-f293078d02ce req-ac78b0c4-13ed-4e2c-b7bb-2d0a8659d199 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:48.550574 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-dd5470d8-9d2a-4c8b-9d53-f293078d02ce req-ac78b0c4-13ed-4e2c-b7bb-2d0a8659d199 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:48.565002 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-dd5470d8-9d2a-4c8b-9d53-f293078d02ce req-ac78b0c4-13ed-4e2c-b7bb-2d0a8659d199 service nova] Creating event network-changed:0799a736-86ba-40d5-8200-f99f2281e899 for instance 1f58c6a6-fa9c-4795-97c2-525c1510124b on hv-cinder-85312 Aug 17 07:30:48.569234 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-dd5470d8-9d2a-4c8b-9d53-f293078d02ce req-ac78b0c4-13ed-4e2c-b7bb-2d0a8659d199 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033318 Aug 17 07:30:48.570529 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 260/515] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:30:48.845820 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-909249b2-20ab-405d-b19c-8c4b02fdef83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:48.846607 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-909249b2-20ab-405d-b19c-8c4b02fdef83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:48.854154 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-909249b2-20ab-405d-b19c-8c4b02fdef83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:48.854759 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-909249b2-20ab-405d-b19c-8c4b02fdef83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:48.855435 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-909249b2-20ab-405d-b19c-8c4b02fdef83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:48.856267 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-909249b2-20ab-405d-b19c-8c4b02fdef83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:48.856826 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-909249b2-20ab-405d-b19c-8c4b02fdef83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:48.857367 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-909249b2-20ab-405d-b19c-8c4b02fdef83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:49.084817 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-909249b2-20ab-405d-b19c-8c4b02fdef83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:49.094186 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-909249b2-20ab-405d-b19c-8c4b02fdef83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1678 microversion: 2.1 time: 0.253960 Aug 17 07:30:49.095522 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 256/516] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:48 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1678 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:49.680516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-60e13655-a811-4bda-a20c-aebd0365c9c3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1952544080", "imageRef": "37843ca7-b19a-44f1-acf3-e9432324d4b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b93cc108-9c01-472b-9ec8-1ea1c98d8816"}], "security_groups": [{"name": "tempest-securitygroup--341038990"}], "key_name": "tempest-keypair-1020590318", "user_data": "}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:49.782803 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.network.neutron [None req-60e13655-a811-4bda-a20c-aebd0365c9c3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] validate_networks() for [('b93cc108-9c01-472b-9ec8-1ea1c98d8816', None, None, None, None, None)] {{(pid=120835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:30:50.116368 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-d1042d75-e6f7-401a-9366-b28f66149e14 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:50.117231 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-d1042d75-e6f7-401a-9366-b28f66149e14 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:50.124900 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d1042d75-e6f7-401a-9366-b28f66149e14 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:50.125379 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d1042d75-e6f7-401a-9366-b28f66149e14 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:50.125819 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d1042d75-e6f7-401a-9366-b28f66149e14 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:50.127103 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d1042d75-e6f7-401a-9366-b28f66149e14 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:50.127572 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d1042d75-e6f7-401a-9366-b28f66149e14 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:50.127981 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d1042d75-e6f7-401a-9366-b28f66149e14 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:50.156003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-60e13655-a811-4bda-a20c-aebd0365c9c3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Flavor limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:30:50.156420 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-60e13655-a811-4bda-a20c-aebd0365c9c3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Image limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:30:50.156884 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-60e13655-a811-4bda-a20c-aebd0365c9c3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Flavor pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:30:50.157343 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-60e13655-a811-4bda-a20c-aebd0365c9c3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Image pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:30:50.157932 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-60e13655-a811-4bda-a20c-aebd0365c9c3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:30:50.166798 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-60e13655-a811-4bda-a20c-aebd0365c9c3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:50.167268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-60e13655-a811-4bda-a20c-aebd0365c9c3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:50.167697 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-60e13655-a811-4bda-a20c-aebd0365c9c3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:50.168586 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-60e13655-a811-4bda-a20c-aebd0365c9c3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:50.169040 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-60e13655-a811-4bda-a20c-aebd0365c9c3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:50.169456 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-60e13655-a811-4bda-a20c-aebd0365c9c3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:50.186992 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-60e13655-a811-4bda-a20c-aebd0365c9c3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Getting quotas for project 99d9a3fa9369495ab6d8da88f3d9dbd5. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:30:50.191684 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-60e13655-a811-4bda-a20c-aebd0365c9c3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Getting quotas for user f8b0c96c80db4db4a477a1fa6c1fa4db and project 99d9a3fa9369495ab6d8da88f3d9dbd5. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:30:50.202874 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-60e13655-a811-4bda-a20c-aebd0365c9c3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Going to run 1 instances... {{(pid=120835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:30:50.205281 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-60e13655-a811-4bda-a20c-aebd0365c9c3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37843ca7-b19a-44f1-acf3-e9432324d4b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:30:50.253518 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-60e13655-a811-4bda-a20c-aebd0365c9c3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.578112 Aug 17 07:30:50.254576 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 261/517] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:30:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 07:30:50.265140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-6601b532-3ba3-4a57-a2f8-4715a7abf940 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:50.265750 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-6601b532-3ba3-4a57-a2f8-4715a7abf940 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:50.267257 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-d1042d75-e6f7-401a-9366-b28f66149e14 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:50.275116 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-d1042d75-e6f7-401a-9366-b28f66149e14 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1678 microversion: 2.1 time: 0.162517 Aug 17 07:30:50.280849 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 257/518] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:50 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:30:50.326228 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-6601b532-3ba3-4a57-a2f8-4715a7abf940 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:50.333486 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-6601b532-3ba3-4a57-a2f8-4715a7abf940 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b" status: 200 len: 1242 microversion: 2.1 time: 0.072448 Aug 17 07:30:50.334237 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 262/519] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:50 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:30:51.296343 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-66c284ea-3963-4e61-a78d-b3e77aa07731 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:51.296959 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-66c284ea-3963-4e61-a78d-b3e77aa07731 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:51.303545 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-66c284ea-3963-4e61-a78d-b3e77aa07731 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:51.304025 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-66c284ea-3963-4e61-a78d-b3e77aa07731 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:51.304458 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-66c284ea-3963-4e61-a78d-b3e77aa07731 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:51.305161 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-66c284ea-3963-4e61-a78d-b3e77aa07731 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:51.305804 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-66c284ea-3963-4e61-a78d-b3e77aa07731 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:51.306268 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-66c284ea-3963-4e61-a78d-b3e77aa07731 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:51.356584 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9253354f-ee79-4dc2-9fbf-1e11a0959804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:51.357191 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-9253354f-ee79-4dc2-9fbf-1e11a0959804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:51.364578 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9253354f-ee79-4dc2-9fbf-1e11a0959804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:51.365267 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9253354f-ee79-4dc2-9fbf-1e11a0959804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:51.366024 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9253354f-ee79-4dc2-9fbf-1e11a0959804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:51.366924 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9253354f-ee79-4dc2-9fbf-1e11a0959804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:51.367772 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9253354f-ee79-4dc2-9fbf-1e11a0959804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:51.368331 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9253354f-ee79-4dc2-9fbf-1e11a0959804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:51.449613 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-9253354f-ee79-4dc2-9fbf-1e11a0959804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:51.458267 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-9253354f-ee79-4dc2-9fbf-1e11a0959804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b" status: 200 len: 1300 microversion: 2.1 time: 0.107183 Aug 17 07:30:51.459241 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 263/520] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:51 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:51.481815 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-66c284ea-3963-4e61-a78d-b3e77aa07731 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:51.490022 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-66c284ea-3963-4e61-a78d-b3e77aa07731 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1678 microversion: 2.1 time: 0.197485 Aug 17 07:30:51.490602 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 258/521] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:51 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1678 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:52.478999 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9b216ea6-d1e8-4df9-b9e5-3d2d39331db9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:52.481005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-9b216ea6-d1e8-4df9-b9e5-3d2d39331db9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:52.487517 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9b216ea6-d1e8-4df9-b9e5-3d2d39331db9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:52.488005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9b216ea6-d1e8-4df9-b9e5-3d2d39331db9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:52.488449 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9b216ea6-d1e8-4df9-b9e5-3d2d39331db9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:52.489147 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9b216ea6-d1e8-4df9-b9e5-3d2d39331db9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:52.489601 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9b216ea6-d1e8-4df9-b9e5-3d2d39331db9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:52.490098 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9b216ea6-d1e8-4df9-b9e5-3d2d39331db9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:52.511530 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1eff57a9-f2a9-40ff-ab22-44d8d1bc93f4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:52.512752 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-1eff57a9-f2a9-40ff-ab22-44d8d1bc93f4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:52.515390 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:52.522133 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1eff57a9-f2a9-40ff-ab22-44d8d1bc93f4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:52.522729 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1eff57a9-f2a9-40ff-ab22-44d8d1bc93f4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:52.523053 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1eff57a9-f2a9-40ff-ab22-44d8d1bc93f4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:52.523815 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1eff57a9-f2a9-40ff-ab22-44d8d1bc93f4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:52.525020 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1eff57a9-f2a9-40ff-ab22-44d8d1bc93f4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:52.525511 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1eff57a9-f2a9-40ff-ab22-44d8d1bc93f4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:52.681762 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-9b216ea6-d1e8-4df9-b9e5-3d2d39331db9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:52.692776 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-9b216ea6-d1e8-4df9-b9e5-3d2d39331db9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b" status: 200 len: 1367 microversion: 2.1 time: 0.217426 Aug 17 07:30:52.706412 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 264/522] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:52 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:52.712288 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-b0871081-eac1-438b-aaba-79359ec57b6f req-422979d7-a02d-40c8-a7fe-13ee63d41d66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b", "tag": "8a9d19f6-6245-4673-9203-4718282d7b7f"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:52.712434 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-1eff57a9-f2a9-40ff-ab22-44d8d1bc93f4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:52.717478 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:52.720869 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-1eff57a9-f2a9-40ff-ab22-44d8d1bc93f4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1678 microversion: 2.1 time: 0.213260 Aug 17 07:30:52.721981 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 259/523] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:52 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1678 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:30:52.727917 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-b0871081-eac1-438b-aaba-79359ec57b6f req-422979d7-a02d-40c8-a7fe-13ee63d41d66 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:52.728527 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-b0871081-eac1-438b-aaba-79359ec57b6f req-422979d7-a02d-40c8-a7fe-13ee63d41d66 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:52.729130 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-b0871081-eac1-438b-aaba-79359ec57b6f req-422979d7-a02d-40c8-a7fe-13ee63d41d66 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:52.740842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-b0871081-eac1-438b-aaba-79359ec57b6f req-422979d7-a02d-40c8-a7fe-13ee63d41d66 service nova] Creating event network-changed:8a9d19f6-6245-4673-9203-4718282d7b7f for instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b on hv-cinder-85312 Aug 17 07:30:52.746078 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-b0871081-eac1-438b-aaba-79359ec57b6f req-422979d7-a02d-40c8-a7fe-13ee63d41d66 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038177 Aug 17 07:30:52.746662 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 265/524] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:30:53.716816 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ac1711b8-550d-40c2-811b-f54f403c80e6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:53.717422 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ac1711b8-550d-40c2-811b-f54f403c80e6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:53.725030 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ac1711b8-550d-40c2-811b-f54f403c80e6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:53.725505 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ac1711b8-550d-40c2-811b-f54f403c80e6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:53.725932 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ac1711b8-550d-40c2-811b-f54f403c80e6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:53.726644 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ac1711b8-550d-40c2-811b-f54f403c80e6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:53.727087 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ac1711b8-550d-40c2-811b-f54f403c80e6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:53.727512 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ac1711b8-550d-40c2-811b-f54f403c80e6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:53.741936 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:53.743577 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c045acf3-100c-4ed5-afd1-890fbe7f200d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:53.744302 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-c045acf3-100c-4ed5-afd1-890fbe7f200d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:53.750867 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c045acf3-100c-4ed5-afd1-890fbe7f200d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:53.751348 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c045acf3-100c-4ed5-afd1-890fbe7f200d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:53.751786 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c045acf3-100c-4ed5-afd1-890fbe7f200d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:53.752482 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c045acf3-100c-4ed5-afd1-890fbe7f200d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:53.752941 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c045acf3-100c-4ed5-afd1-890fbe7f200d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:53.753370 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c045acf3-100c-4ed5-afd1-890fbe7f200d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:53.769177 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:53.925359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ac1711b8-550d-40c2-811b-f54f403c80e6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:53.929283 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c045acf3-100c-4ed5-afd1-890fbe7f200d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:53.932885 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ac1711b8-550d-40c2-811b-f54f403c80e6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b" status: 200 len: 1367 microversion: 2.1 time: 0.219993 Aug 17 07:30:53.933465 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 260/525] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:53 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:53.936979 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-c045acf3-100c-4ed5-afd1-890fbe7f200d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1678 microversion: 2.1 time: 0.198562 Aug 17 07:30:53.937545 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 266/526] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:53 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:54.952987 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f50308e2-e4c8-450c-acca-5577074068a8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:54.953595 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f50308e2-e4c8-450c-acca-5577074068a8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:54.957945 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-dd1e58a8-0081-4d4c-a944-b023727b70a1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:54.958575 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-dd1e58a8-0081-4d4c-a944-b023727b70a1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:54.960687 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f50308e2-e4c8-450c-acca-5577074068a8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:54.961172 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f50308e2-e4c8-450c-acca-5577074068a8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:54.961610 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f50308e2-e4c8-450c-acca-5577074068a8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:54.962343 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f50308e2-e4c8-450c-acca-5577074068a8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:54.962794 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f50308e2-e4c8-450c-acca-5577074068a8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:54.963221 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f50308e2-e4c8-450c-acca-5577074068a8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:54.964935 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dd1e58a8-0081-4d4c-a944-b023727b70a1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:54.965412 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dd1e58a8-0081-4d4c-a944-b023727b70a1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:54.965846 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dd1e58a8-0081-4d4c-a944-b023727b70a1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:54.966552 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dd1e58a8-0081-4d4c-a944-b023727b70a1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:54.967003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dd1e58a8-0081-4d4c-a944-b023727b70a1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:54.967428 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dd1e58a8-0081-4d4c-a944-b023727b70a1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:55.155920 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f50308e2-e4c8-450c-acca-5577074068a8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:55.159832 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-dd1e58a8-0081-4d4c-a944-b023727b70a1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:55.163314 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f50308e2-e4c8-450c-acca-5577074068a8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b" status: 200 len: 1367 microversion: 2.1 time: 0.214190 Aug 17 07:30:55.163874 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 261/527] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:54 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:55.167402 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-dd1e58a8-0081-4d4c-a944-b023727b70a1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1678 microversion: 2.1 time: 0.213801 Aug 17 07:30:55.167961 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 267/528] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:54 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1678 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:30:56.183753 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-badd3cd6-7d9d-44b9-bfa0-61db21ffdf2b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:56.184534 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-badd3cd6-7d9d-44b9-bfa0-61db21ffdf2b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:56.188356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-22acf569-2eaa-4d1f-8dd3-cecb6791be08 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:56.188968 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-22acf569-2eaa-4d1f-8dd3-cecb6791be08 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:56.191115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-badd3cd6-7d9d-44b9-bfa0-61db21ffdf2b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:56.191675 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-badd3cd6-7d9d-44b9-bfa0-61db21ffdf2b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:56.192186 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-badd3cd6-7d9d-44b9-bfa0-61db21ffdf2b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:56.192946 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-badd3cd6-7d9d-44b9-bfa0-61db21ffdf2b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:56.193452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-badd3cd6-7d9d-44b9-bfa0-61db21ffdf2b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:56.194091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-badd3cd6-7d9d-44b9-bfa0-61db21ffdf2b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:56.195783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-22acf569-2eaa-4d1f-8dd3-cecb6791be08 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:56.196263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-22acf569-2eaa-4d1f-8dd3-cecb6791be08 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:56.196879 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-22acf569-2eaa-4d1f-8dd3-cecb6791be08 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:56.197582 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-22acf569-2eaa-4d1f-8dd3-cecb6791be08 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:56.198685 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-22acf569-2eaa-4d1f-8dd3-cecb6791be08 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:56.199160 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-22acf569-2eaa-4d1f-8dd3-cecb6791be08 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:56.388489 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-badd3cd6-7d9d-44b9-bfa0-61db21ffdf2b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:56.393265 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-22acf569-2eaa-4d1f-8dd3-cecb6791be08 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:56.396649 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-badd3cd6-7d9d-44b9-bfa0-61db21ffdf2b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b" status: 200 len: 1367 microversion: 2.1 time: 0.216735 Aug 17 07:30:56.397226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 262/529] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:56 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:56.400928 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-22acf569-2eaa-4d1f-8dd3-cecb6791be08 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1678 microversion: 2.1 time: 0.216390 Aug 17 07:30:56.401577 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 268/530] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:56 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1678 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:30:57.417099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0f5a11d6-4c2d-470e-9354-a558ec9c7a8e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:57.417696 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0f5a11d6-4c2d-470e-9354-a558ec9c7a8e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:57.421393 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-0edbceea-1935-435f-a95c-e9c8398d23f3 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:57.422032 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-0edbceea-1935-435f-a95c-e9c8398d23f3 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:57.424080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0f5a11d6-4c2d-470e-9354-a558ec9c7a8e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:57.424554 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0f5a11d6-4c2d-470e-9354-a558ec9c7a8e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:57.424977 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0f5a11d6-4c2d-470e-9354-a558ec9c7a8e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:57.425726 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0f5a11d6-4c2d-470e-9354-a558ec9c7a8e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:57.426201 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0f5a11d6-4c2d-470e-9354-a558ec9c7a8e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:57.426636 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0f5a11d6-4c2d-470e-9354-a558ec9c7a8e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:57.428419 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0edbceea-1935-435f-a95c-e9c8398d23f3 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:57.428896 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0edbceea-1935-435f-a95c-e9c8398d23f3 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:57.429332 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0edbceea-1935-435f-a95c-e9c8398d23f3 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:57.430054 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0edbceea-1935-435f-a95c-e9c8398d23f3 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:57.430511 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0edbceea-1935-435f-a95c-e9c8398d23f3 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:57.430935 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0edbceea-1935-435f-a95c-e9c8398d23f3 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:57.620649 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0f5a11d6-4c2d-470e-9354-a558ec9c7a8e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:57.623037 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-0edbceea-1935-435f-a95c-e9c8398d23f3 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:57.628555 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0f5a11d6-4c2d-470e-9354-a558ec9c7a8e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b" status: 200 len: 1367 microversion: 2.1 time: 0.215215 Aug 17 07:30:57.629125 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 263/531] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:57 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:57.633191 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-0edbceea-1935-435f-a95c-e9c8398d23f3 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1655 microversion: 2.1 time: 0.215588 Aug 17 07:30:57.633760 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 269/532] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:57 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1655 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:30:57.654602 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7857e9e0-c5a6-4bf2-a485-11790c047458 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:57.661194 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7857e9e0-c5a6-4bf2-a485-11790c047458 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:57.661666 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7857e9e0-c5a6-4bf2-a485-11790c047458 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:57.662160 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7857e9e0-c5a6-4bf2-a485-11790c047458 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:57.683391 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-7857e9e0-c5a6-4bf2-a485-11790c047458 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Going to try to start instance {{(pid=120834) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 17 07:30:57.726356 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-7857e9e0-c5a6-4bf2-a485-11790c047458 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "POST /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22/action" status: 202 len: 0 microversion: 2.1 time: 0.075547 Aug 17 07:30:57.726990 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 264/533] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 17 07:30:57 2022] POST /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:30:57.735813 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-16024ba8-84be-4a84-b467-de53d289cec4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:57.736466 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-16024ba8-84be-4a84-b467-de53d289cec4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:57.743082 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-16024ba8-84be-4a84-b467-de53d289cec4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:57.743558 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-16024ba8-84be-4a84-b467-de53d289cec4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:57.744011 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-16024ba8-84be-4a84-b467-de53d289cec4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:57.744692 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-16024ba8-84be-4a84-b467-de53d289cec4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:57.745273 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-16024ba8-84be-4a84-b467-de53d289cec4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:57.745706 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-16024ba8-84be-4a84-b467-de53d289cec4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:57.767845 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-35a1983b-c85d-4fae-9f62-e90038d82492 req-261d9381-dd3d-4d40-9ad0-313599ca1280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b", "name": "network-vif-plugged", "status": "completed", "tag": "8a9d19f6-6245-4673-9203-4718282d7b7f"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:30:57.777584 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-35a1983b-c85d-4fae-9f62-e90038d82492 req-261d9381-dd3d-4d40-9ad0-313599ca1280 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:57.778077 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-35a1983b-c85d-4fae-9f62-e90038d82492 req-261d9381-dd3d-4d40-9ad0-313599ca1280 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:57.778678 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-35a1983b-c85d-4fae-9f62-e90038d82492 req-261d9381-dd3d-4d40-9ad0-313599ca1280 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:57.790312 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-35a1983b-c85d-4fae-9f62-e90038d82492 req-261d9381-dd3d-4d40-9ad0-313599ca1280 service nova] Creating event network-vif-plugged:8a9d19f6-6245-4673-9203-4718282d7b7f for instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b on hv-cinder-85312 Aug 17 07:30:57.795642 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-35a1983b-c85d-4fae-9f62-e90038d82492 req-261d9381-dd3d-4d40-9ad0-313599ca1280 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032417 Aug 17 07:30:57.796762 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 265/534] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:30:57.903835 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-16024ba8-84be-4a84-b467-de53d289cec4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:57.912982 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-16024ba8-84be-4a84-b467-de53d289cec4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1664 microversion: 2.1 time: 0.181284 Aug 17 07:30:57.914039 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 270/535] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:57 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1664 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:58.646562 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=4 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:58.651062 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a42d5d99-c89c-48f1-a731-95fbf72a57bd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:58.651748 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-a42d5d99-c89c-48f1-a731-95fbf72a57bd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:58.658083 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a42d5d99-c89c-48f1-a731-95fbf72a57bd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:58.658558 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a42d5d99-c89c-48f1-a731-95fbf72a57bd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:58.658989 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a42d5d99-c89c-48f1-a731-95fbf72a57bd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:58.659675 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a42d5d99-c89c-48f1-a731-95fbf72a57bd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:58.660123 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a42d5d99-c89c-48f1-a731-95fbf72a57bd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:58.660548 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a42d5d99-c89c-48f1-a731-95fbf72a57bd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:58.786363 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a42d5d99-c89c-48f1-a731-95fbf72a57bd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:58.793683 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a42d5d99-c89c-48f1-a731-95fbf72a57bd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b" status: 200 len: 1367 microversion: 2.1 time: 0.148196 Aug 17 07:30:58.794267 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 266/536] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:58 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:58.934543 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-063e9d1c-9595-482d-8351-113280d8fee9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:58.935077 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-063e9d1c-9595-482d-8351-113280d8fee9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:58.942132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-063e9d1c-9595-482d-8351-113280d8fee9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:58.942611 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-063e9d1c-9595-482d-8351-113280d8fee9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:58.943046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-063e9d1c-9595-482d-8351-113280d8fee9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:58.943729 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-063e9d1c-9595-482d-8351-113280d8fee9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:58.944184 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-063e9d1c-9595-482d-8351-113280d8fee9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:58.944614 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-063e9d1c-9595-482d-8351-113280d8fee9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:59.072633 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-063e9d1c-9595-482d-8351-113280d8fee9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:59.080041 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-063e9d1c-9595-482d-8351-113280d8fee9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1664 microversion: 2.1 time: 0.149495 Aug 17 07:30:59.080598 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 271/537] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:58 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1664 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:30:59.813980 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-829957a7-152b-43b9-b8ce-646e83d59d90 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:30:59.814577 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-829957a7-152b-43b9-b8ce-646e83d59d90 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:30:59.820855 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-829957a7-152b-43b9-b8ce-646e83d59d90 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:59.821324 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-829957a7-152b-43b9-b8ce-646e83d59d90 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:59.821806 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-829957a7-152b-43b9-b8ce-646e83d59d90 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:59.822509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-829957a7-152b-43b9-b8ce-646e83d59d90 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:30:59.822961 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-829957a7-152b-43b9-b8ce-646e83d59d90 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:30:59.823382 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-829957a7-152b-43b9-b8ce-646e83d59d90 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:30:59.949789 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-829957a7-152b-43b9-b8ce-646e83d59d90 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:30:59.958448 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-829957a7-152b-43b9-b8ce-646e83d59d90 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b" status: 200 len: 1367 microversion: 2.1 time: 0.148256 Aug 17 07:30:59.959015 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 267/538] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:30:59 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:00.101348 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3d2694e8-8bcc-46ff-bcfc-a1c26dfae9a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:00.102886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-3d2694e8-8bcc-46ff-bcfc-a1c26dfae9a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:00.109425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3d2694e8-8bcc-46ff-bcfc-a1c26dfae9a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:00.110016 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3d2694e8-8bcc-46ff-bcfc-a1c26dfae9a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:00.110525 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3d2694e8-8bcc-46ff-bcfc-a1c26dfae9a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:00.111333 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3d2694e8-8bcc-46ff-bcfc-a1c26dfae9a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:00.111866 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3d2694e8-8bcc-46ff-bcfc-a1c26dfae9a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:00.112331 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3d2694e8-8bcc-46ff-bcfc-a1c26dfae9a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:00.178121 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=2 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:00.256840 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3d2694e8-8bcc-46ff-bcfc-a1c26dfae9a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:00.264310 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-3d2694e8-8bcc-46ff-bcfc-a1c26dfae9a2 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1668 microversion: 2.1 time: 0.167330 Aug 17 07:31:00.264871 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 272/539] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:00 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1668 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:00.979300 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-550f68e2-ea08-4766-8433-a3d04781c429 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:00.979909 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-550f68e2-ea08-4766-8433-a3d04781c429 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:00.987235 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-550f68e2-ea08-4766-8433-a3d04781c429 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:00.987709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-550f68e2-ea08-4766-8433-a3d04781c429 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:00.988136 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-550f68e2-ea08-4766-8433-a3d04781c429 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:00.988818 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-550f68e2-ea08-4766-8433-a3d04781c429 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:00.989264 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-550f68e2-ea08-4766-8433-a3d04781c429 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:00.990337 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-550f68e2-ea08-4766-8433-a3d04781c429 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:01.120321 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-550f68e2-ea08-4766-8433-a3d04781c429 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:01.127657 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-550f68e2-ea08-4766-8433-a3d04781c429 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b" status: 200 len: 1557 microversion: 2.1 time: 0.152271 Aug 17 07:31:01.128449 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 268/540] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:00 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:01.148330 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-0e31cbe8-d34c-407e-8fce-454cb4a7cbff tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:01.148862 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-0e31cbe8-d34c-407e-8fce-454cb4a7cbff tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:01.150639 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=8 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:01.156465 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0e31cbe8-d34c-407e-8fce-454cb4a7cbff tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:01.156940 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0e31cbe8-d34c-407e-8fce-454cb4a7cbff tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:01.157375 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0e31cbe8-d34c-407e-8fce-454cb4a7cbff tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:01.158696 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0e31cbe8-d34c-407e-8fce-454cb4a7cbff tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:01.159176 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0e31cbe8-d34c-407e-8fce-454cb4a7cbff tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:01.159599 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0e31cbe8-d34c-407e-8fce-454cb4a7cbff tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:01.233976 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-0e31cbe8-d34c-407e-8fce-454cb4a7cbff tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089464 Aug 17 07:31:01.234579 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 273/541] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 17 07:31:01 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:31:02.137311 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-d9263ef0-fe5e-4a2e-b004-91fe2afce4ae req-68015ce6-f152-488f-a0ee-2a9e3583a8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b", "tag": "8a9d19f6-6245-4673-9203-4718282d7b7f"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:31:02.146986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-d9263ef0-fe5e-4a2e-b004-91fe2afce4ae req-68015ce6-f152-488f-a0ee-2a9e3583a8b5 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:02.147452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-d9263ef0-fe5e-4a2e-b004-91fe2afce4ae req-68015ce6-f152-488f-a0ee-2a9e3583a8b5 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:02.147882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-d9263ef0-fe5e-4a2e-b004-91fe2afce4ae req-68015ce6-f152-488f-a0ee-2a9e3583a8b5 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:02.158388 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-d9263ef0-fe5e-4a2e-b004-91fe2afce4ae req-68015ce6-f152-488f-a0ee-2a9e3583a8b5 service nova] Creating event network-changed:8a9d19f6-6245-4673-9203-4718282d7b7f for instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b on hv-cinder-85312 Aug 17 07:31:02.163512 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-d9263ef0-fe5e-4a2e-b004-91fe2afce4ae req-68015ce6-f152-488f-a0ee-2a9e3583a8b5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029755 Aug 17 07:31:02.164233 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 269/542] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:31:06.063304 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3cc11ef8-24d2-482e-bf66-a79acea6e1ea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:06.064396 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-3cc11ef8-24d2-482e-bf66-a79acea6e1ea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:06.070311 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3cc11ef8-24d2-482e-bf66-a79acea6e1ea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:06.070790 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3cc11ef8-24d2-482e-bf66-a79acea6e1ea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:06.071227 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3cc11ef8-24d2-482e-bf66-a79acea6e1ea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:06.071914 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3cc11ef8-24d2-482e-bf66-a79acea6e1ea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:06.072366 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3cc11ef8-24d2-482e-bf66-a79acea6e1ea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:06.072794 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3cc11ef8-24d2-482e-bf66-a79acea6e1ea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:06.102928 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-3cc11ef8-24d2-482e-bf66-a79acea6e1ea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6/os-volume_attachments/8db163f1-9497-4274-b8d1-053192895161" status: 200 len: 194 microversion: 2.20 time: 0.044207 Aug 17 07:31:06.103491 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 274/543] 10.222.0.45 () {60 vars in 1454 bytes} [Wed Aug 17 07:31:06 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6/os-volume_attachments/8db163f1-9497-4274-b8d1-053192895161 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 07:31:06.171209 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a143c68b-a93b-4a5d-a238-8e4203e178e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:06.171816 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-a143c68b-a93b-4a5d-a238-8e4203e178e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:06.178411 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a143c68b-a93b-4a5d-a238-8e4203e178e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:06.178884 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a143c68b-a93b-4a5d-a238-8e4203e178e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:06.179316 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a143c68b-a93b-4a5d-a238-8e4203e178e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:06.179999 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a143c68b-a93b-4a5d-a238-8e4203e178e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:06.180447 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a143c68b-a93b-4a5d-a238-8e4203e178e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:06.180870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a143c68b-a93b-4a5d-a238-8e4203e178e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:06.259995 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.objects.instance [None req-a143c68b-a93b-4a5d-a238-8e4203e178e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lazy-loading 'services' on Instance uuid 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 {{(pid=120834) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:31:06.329226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a143c68b-a93b-4a5d-a238-8e4203e178e9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6/os-volume_attachments/8db163f1-9497-4274-b8d1-053192895161" status: 202 len: 0 microversion: 2.20 time: 0.162226 Aug 17 07:31:06.330445 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 270/544] 10.222.0.45 () {60 vars in 1457 bytes} [Wed Aug 17 07:31:06 2022] DELETE /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6/os-volume_attachments/8db163f1-9497-4274-b8d1-053192895161 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:31:06.339038 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e8e09f2b-5f0c-4f36-9446-1fcd190683ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:06.341298 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e8e09f2b-5f0c-4f36-9446-1fcd190683ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:06.347371 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e8e09f2b-5f0c-4f36-9446-1fcd190683ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:06.347872 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e8e09f2b-5f0c-4f36-9446-1fcd190683ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:06.348290 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e8e09f2b-5f0c-4f36-9446-1fcd190683ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:06.349173 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e8e09f2b-5f0c-4f36-9446-1fcd190683ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:06.349626 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e8e09f2b-5f0c-4f36-9446-1fcd190683ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:06.350091 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e8e09f2b-5f0c-4f36-9446-1fcd190683ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:06.382746 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e8e09f2b-5f0c-4f36-9446-1fcd190683ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047638 Aug 17 07:31:06.383313 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 275/545] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 17 07:31:06 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 07:31:07.396572 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b95d0186-0cb4-4e54-9da5-0dbf5dcd8dd8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:07.398923 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-b95d0186-0cb4-4e54-9da5-0dbf5dcd8dd8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:07.405673 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b95d0186-0cb4-4e54-9da5-0dbf5dcd8dd8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:07.406188 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b95d0186-0cb4-4e54-9da5-0dbf5dcd8dd8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:07.406622 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b95d0186-0cb4-4e54-9da5-0dbf5dcd8dd8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:07.407307 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b95d0186-0cb4-4e54-9da5-0dbf5dcd8dd8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:07.408391 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b95d0186-0cb4-4e54-9da5-0dbf5dcd8dd8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:07.408813 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b95d0186-0cb4-4e54-9da5-0dbf5dcd8dd8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:07.437688 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b95d0186-0cb4-4e54-9da5-0dbf5dcd8dd8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046129 Aug 17 07:31:07.438268 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 271/546] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 17 07:31:07 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:31:07.498587 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-aa46a023-8189-43a3-9559-a22571adaafb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:07.499210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-aa46a023-8189-43a3-9559-a22571adaafb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:07.506006 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa46a023-8189-43a3-9559-a22571adaafb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:07.506488 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa46a023-8189-43a3-9559-a22571adaafb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:07.506914 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa46a023-8189-43a3-9559-a22571adaafb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:07.507589 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa46a023-8189-43a3-9559-a22571adaafb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:07.508059 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa46a023-8189-43a3-9559-a22571adaafb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:07.508476 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa46a023-8189-43a3-9559-a22571adaafb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:07.534735 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-aa46a023-8189-43a3-9559-a22571adaafb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Going to try to terminate instance {{(pid=120835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:31:07.605593 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-aa46a023-8189-43a3-9559-a22571adaafb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 204 len: 0 microversion: 2.20 time: 0.110564 Aug 17 07:31:07.606132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 276/547] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 17 07:31:07 2022] DELETE /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 07:31:07.614533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a395dff2-6483-45be-9cb5-7a83ceb26935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:07.615235 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-a395dff2-6483-45be-9cb5-7a83ceb26935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:07.622118 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a395dff2-6483-45be-9cb5-7a83ceb26935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:07.622608 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a395dff2-6483-45be-9cb5-7a83ceb26935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:07.623044 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a395dff2-6483-45be-9cb5-7a83ceb26935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:07.623793 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a395dff2-6483-45be-9cb5-7a83ceb26935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:07.624251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a395dff2-6483-45be-9cb5-7a83ceb26935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:07.624675 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a395dff2-6483-45be-9cb5-7a83ceb26935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:07.752795 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a395dff2-6483-45be-9cb5-7a83ceb26935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:07.760705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a395dff2-6483-45be-9cb5-7a83ceb26935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:07.762225 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a395dff2-6483-45be-9cb5-7a83ceb26935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:07.763365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a395dff2-6483-45be-9cb5-7a83ceb26935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.153019 Aug 17 07:31:07.763924 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 272/548] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:31:07 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:31:08.786932 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-bc1db9c6-cbd3-43d5-b366-6dd867420ed8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:08.787620 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-bc1db9c6-cbd3-43d5-b366-6dd867420ed8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:08.793880 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bc1db9c6-cbd3-43d5-b366-6dd867420ed8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:08.794381 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bc1db9c6-cbd3-43d5-b366-6dd867420ed8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:08.794808 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bc1db9c6-cbd3-43d5-b366-6dd867420ed8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:08.795485 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bc1db9c6-cbd3-43d5-b366-6dd867420ed8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:08.795927 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bc1db9c6-cbd3-43d5-b366-6dd867420ed8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:08.796347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bc1db9c6-cbd3-43d5-b366-6dd867420ed8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:09.135528 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-bc1db9c6-cbd3-43d5-b366-6dd867420ed8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:09.143680 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-bc1db9c6-cbd3-43d5-b366-6dd867420ed8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:09.145173 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-bc1db9c6-cbd3-43d5-b366-6dd867420ed8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:09.146343 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-bc1db9c6-cbd3-43d5-b366-6dd867420ed8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1722 microversion: 2.20 time: 0.363638 Aug 17 07:31:09.146899 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 277/549] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:31:08 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1722 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:31:10.168896 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-39cbe2fc-8f1c-4b5c-9611-2474eb89ccc2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:10.169506 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-39cbe2fc-8f1c-4b5c-9611-2474eb89ccc2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:10.177030 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-39cbe2fc-8f1c-4b5c-9611-2474eb89ccc2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:10.177422 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-39cbe2fc-8f1c-4b5c-9611-2474eb89ccc2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:10.177855 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-39cbe2fc-8f1c-4b5c-9611-2474eb89ccc2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:10.178587 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-39cbe2fc-8f1c-4b5c-9611-2474eb89ccc2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:10.179041 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-39cbe2fc-8f1c-4b5c-9611-2474eb89ccc2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:10.179463 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-39cbe2fc-8f1c-4b5c-9611-2474eb89ccc2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:10.243842 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-39cbe2fc-8f1c-4b5c-9611-2474eb89ccc2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:10.253070 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-39cbe2fc-8f1c-4b5c-9611-2474eb89ccc2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:10.254650 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-39cbe2fc-8f1c-4b5c-9611-2474eb89ccc2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:10.255836 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-39cbe2fc-8f1c-4b5c-9611-2474eb89ccc2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 200 len: 1654 microversion: 2.20 time: 0.090877 Aug 17 07:31:10.256395 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 273/550] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:31:10 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 1654 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:31:10.481520 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-72d691d7-6ded-4911-98f6-51942605c4df req-aecb72ec-a1fa-466a-b09c-02ab9cff90a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebfec5b-68c1-41cd-910b-e73220fc2fd6", "name": "network-vif-deleted", "tag": "dc7af87b-fe16-4334-a953-7e5e2d03e8e7"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:31:10.495730 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-72d691d7-6ded-4911-98f6-51942605c4df req-aecb72ec-a1fa-466a-b09c-02ab9cff90a4 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:10.496342 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-72d691d7-6ded-4911-98f6-51942605c4df req-aecb72ec-a1fa-466a-b09c-02ab9cff90a4 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:10.497026 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-72d691d7-6ded-4911-98f6-51942605c4df req-aecb72ec-a1fa-466a-b09c-02ab9cff90a4 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:10.511575 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-72d691d7-6ded-4911-98f6-51942605c4df req-aecb72ec-a1fa-466a-b09c-02ab9cff90a4 service nova] Creating event network-vif-deleted:dc7af87b-fe16-4334-a953-7e5e2d03e8e7 for instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 on hv-cinder-85312 Aug 17 07:31:10.516461 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-72d691d7-6ded-4911-98f6-51942605c4df req-aecb72ec-a1fa-466a-b09c-02ab9cff90a4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038664 Aug 17 07:31:10.517176 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 278/551] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:31:10.715856 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9ea2944c-4cdc-4a16-9b5d-1ddeebdca4c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:31:10.718187 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9ea2944c-4cdc-4a16-9b5d-1ddeebdca4c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:10.724597 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ea2944c-4cdc-4a16-9b5d-1ddeebdca4c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:10.725074 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ea2944c-4cdc-4a16-9b5d-1ddeebdca4c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:10.725505 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ea2944c-4cdc-4a16-9b5d-1ddeebdca4c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:10.726212 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ea2944c-4cdc-4a16-9b5d-1ddeebdca4c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:10.726658 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ea2944c-4cdc-4a16-9b5d-1ddeebdca4c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:10.727078 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ea2944c-4cdc-4a16-9b5d-1ddeebdca4c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:10.798688 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9ea2944c-4cdc-4a16-9b5d-1ddeebdca4c2 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "POST /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/action" status: 202 len: 0 microversion: 2.1 time: 0.086054 Aug 17 07:31:10.799504 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 274/552] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 17 07:31:10 2022] POST /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:31:10.808121 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9ce31e1b-3cc9-42c3-8104-22a16c9c9151 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:10.808949 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-9ce31e1b-3cc9-42c3-8104-22a16c9c9151 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:10.815262 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9ce31e1b-3cc9-42c3-8104-22a16c9c9151 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:10.815804 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9ce31e1b-3cc9-42c3-8104-22a16c9c9151 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:10.816348 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9ce31e1b-3cc9-42c3-8104-22a16c9c9151 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:10.817097 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9ce31e1b-3cc9-42c3-8104-22a16c9c9151 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:10.817611 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9ce31e1b-3cc9-42c3-8104-22a16c9c9151 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:10.818145 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9ce31e1b-3cc9-42c3-8104-22a16c9c9151 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:10.965622 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-9ce31e1b-3cc9-42c3-8104-22a16c9c9151 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:10.974537 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-9ce31e1b-3cc9-42c3-8104-22a16c9c9151 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1750 microversion: 2.1 time: 0.170417 Aug 17 07:31:10.975037 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 279/553] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:10 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1750 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:11.279504 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-94366747-9727-4b6d-8c66-a6d60cb259f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:11.281036 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-94366747-9727-4b6d-8c66-a6d60cb259f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:11.287521 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94366747-9727-4b6d-8c66-a6d60cb259f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:11.288090 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94366747-9727-4b6d-8c66-a6d60cb259f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:11.288593 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94366747-9727-4b6d-8c66-a6d60cb259f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:11.289534 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94366747-9727-4b6d-8c66-a6d60cb259f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:11.290016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94366747-9727-4b6d-8c66-a6d60cb259f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:11.290442 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94366747-9727-4b6d-8c66-a6d60cb259f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:11.305769 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-94366747-9727-4b6d-8c66-a6d60cb259f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] HTTP exception thrown: Instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 could not be found. Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-94366747-9727-4b6d-8c66-a6d60cb259f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Request method failure captured: Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 HTTP/1.1 Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_Jg_8pWHtbGFxg2hEbayc35kHSWHvwkVZX6Bi4Mk8hPivS4i1nayElyjynajz8n4gLfessj95YpoMPJp5GTkZOEam_efTl429cUrsmPKZGkI-W1T3uRrj1gnRWobilaxEN-hKbKI_JdbUrO6XCommw0qVP7AmmTSwD0Xi5TIP2qTTCk Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 58fb14530132434d959da285830fa9b6 Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-236675951 Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:31:11.307629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:31:11.309080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_58fb14530132434d959da285830fa9b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/58fb14530132434d959da285830fa9b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/58fb14530132434d959da285830fa9b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/58fb14530132434d959da285830fa9b6"}]}] Aug 17 07:31:11.309080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-AttachVolumeShelveTestJSON-236675951 Aug 17 07:31:11.309080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 58fb14530132434d959da285830fa9b6 Aug 17 07:31:11.309080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-236675951 Aug 17 07:31:11.309080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-AttachVolumeShelveTestJSON-236675951-project Aug 17 07:31:11.309080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:31:11.309080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:31:11.309080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: 21e14b8bcd4442168c2d1b7cfc956dce Aug 17 07:31:11.309080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-AttachVolumeShelveTestJSON-236675951-project Aug 17 07:31:11.309080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:31:11.309080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 could not be found. Aug 17 07:31:11.309080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': '5ebfec5b-68c1-41cd-910b-e73220fc2fd6'} Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 could not be found. Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:31:11.309882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:31:11.311399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:31:11.311399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:31:11.311399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:31:11.311399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:31:11.311399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:31:11.311399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:31:11.311399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:31:11.311399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 could not be found. Aug 17 07:31:11.311399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:11.311399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:31:11.311399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:11.311399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:31:11.311399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:31:11.311399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:31:11.311399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:31:11.311399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:31:11.311399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 could not be found. Aug 17 07:31:11.311399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:11.312515 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-94366747-9727-4b6d-8c66-a6d60cb259f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Returning 404 to user: Instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:31:11.312515 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-94366747-9727-4b6d-8c66-a6d60cb259f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 404 len: 111 microversion: 2.20 time: 0.034377 Aug 17 07:31:11.312515 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 275/554] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:31:11 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 07:31:11.318797 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9599b4f2-3230-432e-9df5-d3772dc027e7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '.version_select at 0x7f30ac2bdaf0>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:11.343422 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-9599b4f2-3230-432e-9df5-d3772dc027e7 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1441581561" status: 204 len: 0 microversion: 2.20 time: 0.028486 Aug 17 07:31:11.344113 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 280/555] 10.222.0.45 () {60 vars in 1262 bytes} [Wed Aug 17 07:31:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1441581561 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 17 07:31:11.996837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-cbd17014-fdc1-46ba-a2d9-766787be48cc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:11.997355 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-cbd17014-fdc1-46ba-a2d9-766787be48cc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:12.004197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cbd17014-fdc1-46ba-a2d9-766787be48cc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:12.004676 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cbd17014-fdc1-46ba-a2d9-766787be48cc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:12.005113 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cbd17014-fdc1-46ba-a2d9-766787be48cc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:12.005792 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cbd17014-fdc1-46ba-a2d9-766787be48cc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:12.006427 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cbd17014-fdc1-46ba-a2d9-766787be48cc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:12.007044 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cbd17014-fdc1-46ba-a2d9-766787be48cc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:12.015518 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-7f7eb938-9a9e-4117-998c-ae16947359a5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Action: 'create', calling method: .version_select at 0x7f30ac2394c0>, body: {"keypair": {"name": "tempest-keypair-2018583493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtzu7i4rD/IS5xtpyngai0O+GxUTZd2dErrrAeRqKwPEaBAXCDsq93Ue+eIrdoJP4Ycl+Jafxs4CT34CqNZuLuUa47GF4S2vcmn4BGdM1fPLo3zB7gISdBdgFIe3atMEA=="}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:31:12.022208 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:12.031504 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-7f7eb938-9a9e-4117-998c-ae16947359a5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Getting quotas for project 58fb14530132434d959da285830fa9b6. Resources: {'key_pairs'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:31:12.035816 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-7f7eb938-9a9e-4117-998c-ae16947359a5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Getting quotas for user 21e14b8bcd4442168c2d1b7cfc956dce and project 58fb14530132434d959da285830fa9b6. Resources: {'key_pairs'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:31:12.057837 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-7f7eb938-9a9e-4117-998c-ae16947359a5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046594 Aug 17 07:31:12.058639 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 281/556] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Aug 17 07:31:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 17 07:31:12.153307 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-cbd17014-fdc1-46ba-a2d9-766787be48cc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:12.161732 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-cbd17014-fdc1-46ba-a2d9-766787be48cc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1755 microversion: 2.1 time: 0.168898 Aug 17 07:31:12.162526 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 276/557] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:11 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:13.185266 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-32cf9897-cc8f-491a-becc-5798785f51ad tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:13.186074 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-32cf9897-cc8f-491a-becc-5798785f51ad tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:13.192683 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-32cf9897-cc8f-491a-becc-5798785f51ad tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:13.193245 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-32cf9897-cc8f-491a-becc-5798785f51ad tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:13.193756 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-32cf9897-cc8f-491a-becc-5798785f51ad tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:13.194554 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-32cf9897-cc8f-491a-becc-5798785f51ad tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:13.195082 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-32cf9897-cc8f-491a-becc-5798785f51ad tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:13.195598 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-32cf9897-cc8f-491a-becc-5798785f51ad tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:13.317239 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-990472030", "imageRef": "37843ca7-b19a-44f1-acf3-e9432324d4b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "356b41b9-fa7f-45f5-8619-f5e71d8ddd74"}], "security_groups": [{"name": "tempest-securitygroup--461060823"}], "key_name": "tempest-keypair-2018583493", "user_data": "}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:31:13.337416 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-32cf9897-cc8f-491a-becc-5798785f51ad tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:13.345692 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-32cf9897-cc8f-491a-becc-5798785f51ad tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1755 microversion: 2.1 time: 0.165907 Aug 17 07:31:13.346508 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 282/558] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:13 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:13.417797 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.network.neutron [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] validate_networks() for [('356b41b9-fa7f-45f5-8619-f5e71d8ddd74', None, None, None, None, None)] {{(pid=120834) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:31:13.777334 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Flavor limits 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:31:13.777704 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Image limits 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:31:13.778207 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Flavor pref 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:31:13.778606 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Image pref 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:31:13.779007 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:31:13.788140 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:13.788604 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:13.789025 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:13.789729 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:13.790200 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:13.790615 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:13.807212 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Getting quotas for project 58fb14530132434d959da285830fa9b6. Resources: {'ram', 'cores', 'instances'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:31:13.811076 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Getting quotas for user 21e14b8bcd4442168c2d1b7cfc956dce and project 58fb14530132434d959da285830fa9b6. Resources: {'ram', 'cores', 'instances'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:31:13.821711 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Going to run 1 instances... {{(pid=120834) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:31:13.824016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37843ca7-b19a-44f1-acf3-e9432324d4b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120834) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:31:13.866029 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [f778fe56-40b6-47ee-a72b-18de7a6b1197] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 07:31:14.367682 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b0c8a0f0-4e2a-462e-aab0-85f608fffa86 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:14.368297 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-b0c8a0f0-4e2a-462e-aab0-85f608fffa86 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:14.374666 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b0c8a0f0-4e2a-462e-aab0-85f608fffa86 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:14.375131 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b0c8a0f0-4e2a-462e-aab0-85f608fffa86 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:14.375559 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b0c8a0f0-4e2a-462e-aab0-85f608fffa86 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:14.376733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b0c8a0f0-4e2a-462e-aab0-85f608fffa86 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:14.377172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b0c8a0f0-4e2a-462e-aab0-85f608fffa86 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:14.377592 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b0c8a0f0-4e2a-462e-aab0-85f608fffa86 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:14.515210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b0c8a0f0-4e2a-462e-aab0-85f608fffa86 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:14.523665 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b0c8a0f0-4e2a-462e-aab0-85f608fffa86 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1755 microversion: 2.1 time: 0.160073 Aug 17 07:31:14.524227 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 283/559] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:14 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:31:14.874192 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO oslo.messaging._drivers.impl_rabbit [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [f778fe56-40b6-47ee-a72b-18de7a6b1197] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 44812. Aug 17 07:31:14.879294 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-e534e027-f491-4342-84d3-9c27f659bcef tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.566912 Aug 17 07:31:14.880122 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 277/560] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Aug 17 07:31:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 17 07:31:14.890730 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2a7f4293-157a-4f7c-b618-77c90b447c69 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:14.891335 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-2a7f4293-157a-4f7c-b618-77c90b447c69 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:14.942974 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2a7f4293-157a-4f7c-b618-77c90b447c69 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:14.950009 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2a7f4293-157a-4f7c-b618-77c90b447c69 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:14.951539 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2a7f4293-157a-4f7c-b618-77c90b447c69 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:14.952625 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-2a7f4293-157a-4f7c-b618-77c90b447c69 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1281 microversion: 2.20 time: 0.065791 Aug 17 07:31:14.953187 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 284/561] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:31:14 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1281 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:31:15.545170 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1ce20bca-012e-4e63-b197-d0e2097711de tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:15.545775 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-1ce20bca-012e-4e63-b197-d0e2097711de tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:15.551893 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1ce20bca-012e-4e63-b197-d0e2097711de tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:15.552396 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1ce20bca-012e-4e63-b197-d0e2097711de tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:15.552824 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1ce20bca-012e-4e63-b197-d0e2097711de tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:15.553507 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1ce20bca-012e-4e63-b197-d0e2097711de tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:15.553951 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1ce20bca-012e-4e63-b197-d0e2097711de tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:15.554397 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1ce20bca-012e-4e63-b197-d0e2097711de tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:15.696554 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-1ce20bca-012e-4e63-b197-d0e2097711de tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:15.704989 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-1ce20bca-012e-4e63-b197-d0e2097711de tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1755 microversion: 2.1 time: 0.164178 Aug 17 07:31:15.705545 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 278/562] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:15 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:15.974540 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2bad5040-8603-4498-a44d-0ef899e71f86 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:15.975173 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-2bad5040-8603-4498-a44d-0ef899e71f86 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:15.984627 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2bad5040-8603-4498-a44d-0ef899e71f86 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:15.985210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2bad5040-8603-4498-a44d-0ef899e71f86 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:15.985710 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2bad5040-8603-4498-a44d-0ef899e71f86 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:15.986508 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2bad5040-8603-4498-a44d-0ef899e71f86 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:15.987059 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2bad5040-8603-4498-a44d-0ef899e71f86 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:15.987563 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2bad5040-8603-4498-a44d-0ef899e71f86 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:16.003532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:16.059567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2bad5040-8603-4498-a44d-0ef899e71f86 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:16.070072 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2bad5040-8603-4498-a44d-0ef899e71f86 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:16.071601 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2bad5040-8603-4498-a44d-0ef899e71f86 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:16.072738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-2bad5040-8603-4498-a44d-0ef899e71f86 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1351 microversion: 2.20 time: 0.102614 Aug 17 07:31:16.073314 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 285/563] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:31:15 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:31:16.726714 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-89fa195f-ef27-4e89-bce2-2c21ec344495 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:16.727322 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-89fa195f-ef27-4e89-bce2-2c21ec344495 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:16.734240 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-89fa195f-ef27-4e89-bce2-2c21ec344495 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:16.734718 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-89fa195f-ef27-4e89-bce2-2c21ec344495 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:16.735148 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-89fa195f-ef27-4e89-bce2-2c21ec344495 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:16.736414 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-89fa195f-ef27-4e89-bce2-2c21ec344495 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:16.736867 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-89fa195f-ef27-4e89-bce2-2c21ec344495 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:16.737284 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-89fa195f-ef27-4e89-bce2-2c21ec344495 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:16.895346 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-89fa195f-ef27-4e89-bce2-2c21ec344495 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:16.904494 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-89fa195f-ef27-4e89-bce2-2c21ec344495 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1755 microversion: 2.1 time: 0.181625 Aug 17 07:31:16.905078 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 279/564] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:16 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:17.096211 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-1692f938-5532-41ec-8d6b-a64272c88df3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:17.097443 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-1692f938-5532-41ec-8d6b-a64272c88df3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:17.103991 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1692f938-5532-41ec-8d6b-a64272c88df3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:17.104462 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1692f938-5532-41ec-8d6b-a64272c88df3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:17.104888 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1692f938-5532-41ec-8d6b-a64272c88df3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:17.105572 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1692f938-5532-41ec-8d6b-a64272c88df3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:17.106043 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1692f938-5532-41ec-8d6b-a64272c88df3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:17.106464 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1692f938-5532-41ec-8d6b-a64272c88df3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:17.237871 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-1692f938-5532-41ec-8d6b-a64272c88df3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:17.245913 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-1692f938-5532-41ec-8d6b-a64272c88df3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:17.247504 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-1692f938-5532-41ec-8d6b-a64272c88df3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:17.248593 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-1692f938-5532-41ec-8d6b-a64272c88df3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1406 microversion: 2.20 time: 0.156887 Aug 17 07:31:17.249142 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 286/565] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:31:17 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:31:17.283928 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-0991d6a6-415d-4921-9589-71b36ae69da9 req-9189395c-9747-4793-abd0-45ed4f0ce0ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c084749b-e2a5-48ae-a864-1ef8c56b5934", "tag": "9ba8e1e3-4b4b-4036-bc27-7a1fb46ead6d"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:31:17.294681 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-0991d6a6-415d-4921-9589-71b36ae69da9 req-9189395c-9747-4793-abd0-45ed4f0ce0ce service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:17.295120 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-0991d6a6-415d-4921-9589-71b36ae69da9 req-9189395c-9747-4793-abd0-45ed4f0ce0ce service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:17.295586 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-0991d6a6-415d-4921-9589-71b36ae69da9 req-9189395c-9747-4793-abd0-45ed4f0ce0ce service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:17.308637 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-0991d6a6-415d-4921-9589-71b36ae69da9 req-9189395c-9747-4793-abd0-45ed4f0ce0ce service nova] Creating event network-changed:9ba8e1e3-4b4b-4036-bc27-7a1fb46ead6d for instance c084749b-e2a5-48ae-a864-1ef8c56b5934 on hv-cinder-85312 Aug 17 07:31:17.314889 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-0991d6a6-415d-4921-9589-71b36ae69da9 req-9189395c-9747-4793-abd0-45ed4f0ce0ce service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034284 Aug 17 07:31:17.315423 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 280/566] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:31:17.926723 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-81a66467-c6f1-40fc-ba90-7a7c50a46f3f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:17.927249 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-81a66467-c6f1-40fc-ba90-7a7c50a46f3f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:17.933130 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-81a66467-c6f1-40fc-ba90-7a7c50a46f3f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:17.933602 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-81a66467-c6f1-40fc-ba90-7a7c50a46f3f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:17.934192 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-81a66467-c6f1-40fc-ba90-7a7c50a46f3f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:17.934877 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-81a66467-c6f1-40fc-ba90-7a7c50a46f3f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:17.935321 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-81a66467-c6f1-40fc-ba90-7a7c50a46f3f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:17.935741 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-81a66467-c6f1-40fc-ba90-7a7c50a46f3f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:18.074115 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-81a66467-c6f1-40fc-ba90-7a7c50a46f3f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:18.082100 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-81a66467-c6f1-40fc-ba90-7a7c50a46f3f tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1755 microversion: 2.1 time: 0.159934 Aug 17 07:31:18.082657 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 287/567] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:17 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:18.272114 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-5c3c81cb-70e8-4c78-8702-916e830cbda3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:18.272816 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-5c3c81cb-70e8-4c78-8702-916e830cbda3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:18.279439 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5c3c81cb-70e8-4c78-8702-916e830cbda3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:18.279918 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5c3c81cb-70e8-4c78-8702-916e830cbda3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:18.280390 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5c3c81cb-70e8-4c78-8702-916e830cbda3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:18.281083 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5c3c81cb-70e8-4c78-8702-916e830cbda3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:18.281536 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5c3c81cb-70e8-4c78-8702-916e830cbda3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:18.282487 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5c3c81cb-70e8-4c78-8702-916e830cbda3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:18.414312 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-5c3c81cb-70e8-4c78-8702-916e830cbda3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:18.422187 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-5c3c81cb-70e8-4c78-8702-916e830cbda3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:18.423730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-5c3c81cb-70e8-4c78-8702-916e830cbda3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:18.424823 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-5c3c81cb-70e8-4c78-8702-916e830cbda3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1406 microversion: 2.20 time: 0.157056 Aug 17 07:31:18.425381 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 281/568] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:31:18 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:31:19.103549 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-1b753ab9-a349-4c74-9ebf-f63ddaeff481 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:19.104168 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-1b753ab9-a349-4c74-9ebf-f63ddaeff481 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:19.111853 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1b753ab9-a349-4c74-9ebf-f63ddaeff481 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:19.112339 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1b753ab9-a349-4c74-9ebf-f63ddaeff481 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:19.112779 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1b753ab9-a349-4c74-9ebf-f63ddaeff481 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:19.113477 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1b753ab9-a349-4c74-9ebf-f63ddaeff481 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:19.113930 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1b753ab9-a349-4c74-9ebf-f63ddaeff481 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:19.114383 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1b753ab9-a349-4c74-9ebf-f63ddaeff481 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:19.255430 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-1b753ab9-a349-4c74-9ebf-f63ddaeff481 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:19.263243 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-1b753ab9-a349-4c74-9ebf-f63ddaeff481 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1755 microversion: 2.1 time: 0.163579 Aug 17 07:31:19.263810 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 288/569] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:19 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:19.446691 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f50c780a-570f-424b-a30b-fc37c1933104 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:19.447291 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f50c780a-570f-424b-a30b-fc37c1933104 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:19.453542 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f50c780a-570f-424b-a30b-fc37c1933104 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:19.454551 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f50c780a-570f-424b-a30b-fc37c1933104 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:19.454980 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f50c780a-570f-424b-a30b-fc37c1933104 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:19.455679 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f50c780a-570f-424b-a30b-fc37c1933104 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:19.456120 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f50c780a-570f-424b-a30b-fc37c1933104 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:19.456535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f50c780a-570f-424b-a30b-fc37c1933104 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:19.585867 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f50c780a-570f-424b-a30b-fc37c1933104 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:19.593764 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f50c780a-570f-424b-a30b-fc37c1933104 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:19.595295 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f50c780a-570f-424b-a30b-fc37c1933104 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:19.596376 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f50c780a-570f-424b-a30b-fc37c1933104 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1406 microversion: 2.20 time: 0.153547 Aug 17 07:31:19.596929 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 282/570] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:31:19 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:31:20.285229 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2449fdbd-20e0-402b-9040-a82dc6b05cf6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:20.285878 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-2449fdbd-20e0-402b-9040-a82dc6b05cf6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:20.292676 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2449fdbd-20e0-402b-9040-a82dc6b05cf6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:20.293155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2449fdbd-20e0-402b-9040-a82dc6b05cf6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:20.293582 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2449fdbd-20e0-402b-9040-a82dc6b05cf6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:20.294304 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2449fdbd-20e0-402b-9040-a82dc6b05cf6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:20.294749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2449fdbd-20e0-402b-9040-a82dc6b05cf6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:20.295168 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2449fdbd-20e0-402b-9040-a82dc6b05cf6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:20.446249 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2449fdbd-20e0-402b-9040-a82dc6b05cf6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:20.454317 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-2449fdbd-20e0-402b-9040-a82dc6b05cf6 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1755 microversion: 2.1 time: 0.173451 Aug 17 07:31:20.454891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 289/571] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:20 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:20.618490 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ba28a9a6-2c2f-43bf-b86d-6c794e16114c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:20.619019 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ba28a9a6-2c2f-43bf-b86d-6c794e16114c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:20.625364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ba28a9a6-2c2f-43bf-b86d-6c794e16114c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:20.625833 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ba28a9a6-2c2f-43bf-b86d-6c794e16114c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:20.626303 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ba28a9a6-2c2f-43bf-b86d-6c794e16114c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:20.626980 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ba28a9a6-2c2f-43bf-b86d-6c794e16114c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:20.627427 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ba28a9a6-2c2f-43bf-b86d-6c794e16114c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:20.627842 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ba28a9a6-2c2f-43bf-b86d-6c794e16114c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:20.754472 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ba28a9a6-2c2f-43bf-b86d-6c794e16114c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:20.762244 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ba28a9a6-2c2f-43bf-b86d-6c794e16114c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:20.763949 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ba28a9a6-2c2f-43bf-b86d-6c794e16114c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:20.765030 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ba28a9a6-2c2f-43bf-b86d-6c794e16114c tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1406 microversion: 2.20 time: 0.150841 Aug 17 07:31:20.765586 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 283/572] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:31:20 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:31:21.475473 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-8d133f88-abc5-4e37-a14e-658f4e9edddc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:21.476078 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-8d133f88-abc5-4e37-a14e-658f4e9edddc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:21.482554 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8d133f88-abc5-4e37-a14e-658f4e9edddc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:21.483024 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8d133f88-abc5-4e37-a14e-658f4e9edddc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:21.483453 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8d133f88-abc5-4e37-a14e-658f4e9edddc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:21.484124 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8d133f88-abc5-4e37-a14e-658f4e9edddc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:21.484567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8d133f88-abc5-4e37-a14e-658f4e9edddc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:21.484985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8d133f88-abc5-4e37-a14e-658f4e9edddc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:21.625149 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-8d133f88-abc5-4e37-a14e-658f4e9edddc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:21.633817 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-8d133f88-abc5-4e37-a14e-658f4e9edddc tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1755 microversion: 2.1 time: 0.162278 Aug 17 07:31:21.634424 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 290/573] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:21 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:21.787449 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-36afd24b-fbbe-4526-9337-a324ad9e2f6e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:21.788043 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-36afd24b-fbbe-4526-9337-a324ad9e2f6e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:21.794381 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-36afd24b-fbbe-4526-9337-a324ad9e2f6e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:21.794852 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-36afd24b-fbbe-4526-9337-a324ad9e2f6e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:21.795279 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-36afd24b-fbbe-4526-9337-a324ad9e2f6e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:21.795965 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-36afd24b-fbbe-4526-9337-a324ad9e2f6e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:21.796408 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-36afd24b-fbbe-4526-9337-a324ad9e2f6e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:21.796972 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-36afd24b-fbbe-4526-9337-a324ad9e2f6e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:21.864287 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-89825d07-cac7-485b-8145-5dabc3094506 req-a3a76dba-e3af-4392-b14c-5963b8fed7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c084749b-e2a5-48ae-a864-1ef8c56b5934", "name": "network-vif-plugged", "status": "completed", "tag": "9ba8e1e3-4b4b-4036-bc27-7a1fb46ead6d"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:31:21.875806 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-89825d07-cac7-485b-8145-5dabc3094506 req-a3a76dba-e3af-4392-b14c-5963b8fed7bd service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:21.876394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-89825d07-cac7-485b-8145-5dabc3094506 req-a3a76dba-e3af-4392-b14c-5963b8fed7bd service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:21.877029 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-89825d07-cac7-485b-8145-5dabc3094506 req-a3a76dba-e3af-4392-b14c-5963b8fed7bd service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:21.889203 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-89825d07-cac7-485b-8145-5dabc3094506 req-a3a76dba-e3af-4392-b14c-5963b8fed7bd service nova] Creating event network-vif-plugged:9ba8e1e3-4b4b-4036-bc27-7a1fb46ead6d for instance c084749b-e2a5-48ae-a864-1ef8c56b5934 on hv-cinder-85312 Aug 17 07:31:21.895167 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-89825d07-cac7-485b-8145-5dabc3094506 req-a3a76dba-e3af-4392-b14c-5963b8fed7bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034543 Aug 17 07:31:21.896062 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 291/574] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:31:21.932970 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-36afd24b-fbbe-4526-9337-a324ad9e2f6e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:21.944769 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-36afd24b-fbbe-4526-9337-a324ad9e2f6e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:21.946325 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-36afd24b-fbbe-4526-9337-a324ad9e2f6e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:21.947458 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-36afd24b-fbbe-4526-9337-a324ad9e2f6e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1406 microversion: 2.20 time: 0.163931 Aug 17 07:31:21.948011 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 284/575] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:31:21 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:31:22.655723 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e233fa0e-c6e7-49cd-95aa-ab86e867d0ee tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:22.656417 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e233fa0e-c6e7-49cd-95aa-ab86e867d0ee tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:22.662998 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e233fa0e-c6e7-49cd-95aa-ab86e867d0ee tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:22.663482 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e233fa0e-c6e7-49cd-95aa-ab86e867d0ee tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:22.663916 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e233fa0e-c6e7-49cd-95aa-ab86e867d0ee tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:22.664634 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e233fa0e-c6e7-49cd-95aa-ab86e867d0ee tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:22.665163 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e233fa0e-c6e7-49cd-95aa-ab86e867d0ee tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:22.665711 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e233fa0e-c6e7-49cd-95aa-ab86e867d0ee tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:22.808334 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-e233fa0e-c6e7-49cd-95aa-ab86e867d0ee tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:22.816766 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e233fa0e-c6e7-49cd-95aa-ab86e867d0ee tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1758 microversion: 2.1 time: 0.165330 Aug 17 07:31:22.817336 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 292/576] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:22 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:22.968544 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-4ce9f684-b878-4fc3-92b0-b060ee27ac02 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:22.969145 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-4ce9f684-b878-4fc3-92b0-b060ee27ac02 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:22.971574 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:22.976681 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4ce9f684-b878-4fc3-92b0-b060ee27ac02 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:22.977159 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4ce9f684-b878-4fc3-92b0-b060ee27ac02 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:22.977592 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4ce9f684-b878-4fc3-92b0-b060ee27ac02 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:22.978308 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4ce9f684-b878-4fc3-92b0-b060ee27ac02 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:22.978761 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4ce9f684-b878-4fc3-92b0-b060ee27ac02 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:22.979179 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4ce9f684-b878-4fc3-92b0-b060ee27ac02 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:23.112799 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-4ce9f684-b878-4fc3-92b0-b060ee27ac02 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:23.120807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-4ce9f684-b878-4fc3-92b0-b060ee27ac02 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:23.122341 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-4ce9f684-b878-4fc3-92b0-b060ee27ac02 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:23.123427 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-4ce9f684-b878-4fc3-92b0-b060ee27ac02 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1406 microversion: 2.20 time: 0.158771 Aug 17 07:31:23.124013 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 285/577] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:31:22 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:31:24.146734 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3c86d580-32a3-4025-bb4e-a3fd6d1b9362 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:24.147331 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-3c86d580-32a3-4025-bb4e-a3fd6d1b9362 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:24.149706 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:24.155447 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3c86d580-32a3-4025-bb4e-a3fd6d1b9362 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:24.155945 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3c86d580-32a3-4025-bb4e-a3fd6d1b9362 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:24.156375 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3c86d580-32a3-4025-bb4e-a3fd6d1b9362 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:24.157046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3c86d580-32a3-4025-bb4e-a3fd6d1b9362 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:24.157494 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3c86d580-32a3-4025-bb4e-a3fd6d1b9362 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:24.157912 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3c86d580-32a3-4025-bb4e-a3fd6d1b9362 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:24.290245 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3c86d580-32a3-4025-bb4e-a3fd6d1b9362 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:24.298188 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3c86d580-32a3-4025-bb4e-a3fd6d1b9362 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:24.299677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3c86d580-32a3-4025-bb4e-a3fd6d1b9362 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:24.300762 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-3c86d580-32a3-4025-bb4e-a3fd6d1b9362 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1406 microversion: 2.20 time: 0.157942 Aug 17 07:31:24.301322 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 293/578] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:31:24 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:31:25.253637 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-378ef53b-b7a4-496f-b722-096b0bcee6cd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:25.254173 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-378ef53b-b7a4-496f-b722-096b0bcee6cd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:25.256015 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=2 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:25.256669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=6 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:25.263370 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-378ef53b-b7a4-496f-b722-096b0bcee6cd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:25.263850 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-378ef53b-b7a4-496f-b722-096b0bcee6cd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:25.264286 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-378ef53b-b7a4-496f-b722-096b0bcee6cd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:25.264972 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-378ef53b-b7a4-496f-b722-096b0bcee6cd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:25.265422 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-378ef53b-b7a4-496f-b722-096b0bcee6cd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:25.265848 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-378ef53b-b7a4-496f-b722-096b0bcee6cd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:25.323240 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-97a8becf-fa07-4820-9304-10ea85704e44 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:25.324171 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-97a8becf-fa07-4820-9304-10ea85704e44 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:25.325691 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=6 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:25.332159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-97a8becf-fa07-4820-9304-10ea85704e44 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:25.332644 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-97a8becf-fa07-4820-9304-10ea85704e44 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:25.333081 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-97a8becf-fa07-4820-9304-10ea85704e44 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:25.333774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-97a8becf-fa07-4820-9304-10ea85704e44 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:25.334262 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-97a8becf-fa07-4820-9304-10ea85704e44 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:25.334690 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-97a8becf-fa07-4820-9304-10ea85704e44 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:25.348525 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.objects.instance [None req-378ef53b-b7a4-496f-b722-096b0bcee6cd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lazy-loading 'services' on Instance uuid 1f58c6a6-fa9c-4795-97c2-525c1510124b {{(pid=120834) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:31:25.429049 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-378ef53b-b7a4-496f-b722-096b0bcee6cd tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/os-volume_attachments/9254b136-155d-4ea8-b1a1-399209c81656" status: 202 len: 0 microversion: 2.1 time: 0.179161 Aug 17 07:31:25.429865 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 286/579] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 17 07:31:25 2022] DELETE /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/os-volume_attachments/9254b136-155d-4ea8-b1a1-399209c81656 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:31:25.438934 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-32588392-ab9c-4fac-84ea-a13980134685 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:25.441284 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-32588392-ab9c-4fac-84ea-a13980134685 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:25.447748 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-32588392-ab9c-4fac-84ea-a13980134685 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:25.448245 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-32588392-ab9c-4fac-84ea-a13980134685 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:25.448687 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-32588392-ab9c-4fac-84ea-a13980134685 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:25.449497 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-32588392-ab9c-4fac-84ea-a13980134685 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:25.450025 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-32588392-ab9c-4fac-84ea-a13980134685 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:25.450555 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-32588392-ab9c-4fac-84ea-a13980134685 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:25.467366 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-97a8becf-fa07-4820-9304-10ea85704e44 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:25.477526 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-97a8becf-fa07-4820-9304-10ea85704e44 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:25.479454 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-97a8becf-fa07-4820-9304-10ea85704e44 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:25.480612 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-97a8becf-fa07-4820-9304-10ea85704e44 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1597 microversion: 2.20 time: 0.161246 Aug 17 07:31:25.481168 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 294/580] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:31:25 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1597 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:31:25.482712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-32588392-ab9c-4fac-84ea-a13980134685 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048379 Aug 17 07:31:25.483279 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 287/581] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:31:25 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:31:25.504358 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-4d8081f1-8251-437f-abd8-8d87fc826069 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:25.504849 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-4d8081f1-8251-437f-abd8-8d87fc826069 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:25.510711 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4d8081f1-8251-437f-abd8-8d87fc826069 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:25.511179 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4d8081f1-8251-437f-abd8-8d87fc826069 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:25.511608 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4d8081f1-8251-437f-abd8-8d87fc826069 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:25.512285 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4d8081f1-8251-437f-abd8-8d87fc826069 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:25.512731 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4d8081f1-8251-437f-abd8-8d87fc826069 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:25.513145 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4d8081f1-8251-437f-abd8-8d87fc826069 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:25.588603 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-4d8081f1-8251-437f-abd8-8d87fc826069 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088552 Aug 17 07:31:25.589213 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 295/582] 10.222.0.45 () {60 vars in 1316 bytes} [Wed Aug 17 07:31:25 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 07:31:26.495186 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-41e411ff-e10d-4b7f-b618-1ffafb208240 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:26.496618 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-105e414f-749d-4a02-9cb4-6d18a471457e req-90cc02c9-8112-41a8-8c06-f07ed710902d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c084749b-e2a5-48ae-a864-1ef8c56b5934", "tag": "9ba8e1e3-4b4b-4036-bc27-7a1fb46ead6d"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:31:26.497583 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-41e411ff-e10d-4b7f-b618-1ffafb208240 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:26.505225 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-41e411ff-e10d-4b7f-b618-1ffafb208240 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:26.505799 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-41e411ff-e10d-4b7f-b618-1ffafb208240 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:26.506341 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-41e411ff-e10d-4b7f-b618-1ffafb208240 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:26.507113 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-41e411ff-e10d-4b7f-b618-1ffafb208240 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:26.507846 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-41e411ff-e10d-4b7f-b618-1ffafb208240 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:26.508334 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-41e411ff-e10d-4b7f-b618-1ffafb208240 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:26.509109 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-105e414f-749d-4a02-9cb4-6d18a471457e req-90cc02c9-8112-41a8-8c06-f07ed710902d service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:26.509579 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-105e414f-749d-4a02-9cb4-6d18a471457e req-90cc02c9-8112-41a8-8c06-f07ed710902d service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:26.510063 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-105e414f-749d-4a02-9cb4-6d18a471457e req-90cc02c9-8112-41a8-8c06-f07ed710902d service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:26.523569 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-105e414f-749d-4a02-9cb4-6d18a471457e req-90cc02c9-8112-41a8-8c06-f07ed710902d service nova] Creating event network-changed:9ba8e1e3-4b4b-4036-bc27-7a1fb46ead6d for instance c084749b-e2a5-48ae-a864-1ef8c56b5934 on hv-cinder-85312 Aug 17 07:31:26.529252 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-105e414f-749d-4a02-9cb4-6d18a471457e req-90cc02c9-8112-41a8-8c06-f07ed710902d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037297 Aug 17 07:31:26.529846 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 296/583] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:31:26.539262 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-41e411ff-e10d-4b7f-b618-1ffafb208240 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048674 Aug 17 07:31:26.539909 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 288/584] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:31:26 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 07:31:26.624797 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-fb8cc43b-d054-4c83-a961-c2b64e25fabf tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:26.625645 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-fb8cc43b-d054-4c83-a961-c2b64e25fabf tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:26.633161 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fb8cc43b-d054-4c83-a961-c2b64e25fabf tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:26.634063 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fb8cc43b-d054-4c83-a961-c2b64e25fabf tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:26.634849 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fb8cc43b-d054-4c83-a961-c2b64e25fabf tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:26.636123 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fb8cc43b-d054-4c83-a961-c2b64e25fabf tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:26.636968 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fb8cc43b-d054-4c83-a961-c2b64e25fabf tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:26.637774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fb8cc43b-d054-4c83-a961-c2b64e25fabf tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:26.666129 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-fb8cc43b-d054-4c83-a961-c2b64e25fabf tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Going to try to terminate instance {{(pid=120835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:31:26.755994 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-fb8cc43b-d054-4c83-a961-c2b64e25fabf tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 204 len: 0 microversion: 2.1 time: 0.134173 Aug 17 07:31:26.757698 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 297/585] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:31:26 2022] DELETE /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:31:26.765588 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-586b1f23-1ebf-4e3d-bbd6-c3614a644370 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:26.766359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-586b1f23-1ebf-4e3d-bbd6-c3614a644370 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:26.772492 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-586b1f23-1ebf-4e3d-bbd6-c3614a644370 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:26.773088 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-586b1f23-1ebf-4e3d-bbd6-c3614a644370 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:26.773629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-586b1f23-1ebf-4e3d-bbd6-c3614a644370 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:26.774609 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-586b1f23-1ebf-4e3d-bbd6-c3614a644370 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:26.775279 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-586b1f23-1ebf-4e3d-bbd6-c3614a644370 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:26.775797 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-586b1f23-1ebf-4e3d-bbd6-c3614a644370 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:26.908461 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-586b1f23-1ebf-4e3d-bbd6-c3614a644370 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:26.916006 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-586b1f23-1ebf-4e3d-bbd6-c3614a644370 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1691 microversion: 2.1 time: 0.154206 Aug 17 07:31:26.916570 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 289/586] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:26 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:27.938041 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-4f643ac2-3341-4ec7-ad13-04748aaffc37 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:27.939246 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-4f643ac2-3341-4ec7-ad13-04748aaffc37 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:27.945586 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4f643ac2-3341-4ec7-ad13-04748aaffc37 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:27.946093 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4f643ac2-3341-4ec7-ad13-04748aaffc37 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:27.946533 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4f643ac2-3341-4ec7-ad13-04748aaffc37 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:27.947220 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4f643ac2-3341-4ec7-ad13-04748aaffc37 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:27.947673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4f643ac2-3341-4ec7-ad13-04748aaffc37 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:27.948098 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4f643ac2-3341-4ec7-ad13-04748aaffc37 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:28.075935 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-4f643ac2-3341-4ec7-ad13-04748aaffc37 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:28.085883 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-4f643ac2-3341-4ec7-ad13-04748aaffc37 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1691 microversion: 2.1 time: 0.152141 Aug 17 07:31:28.086472 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 298/587] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:27 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:29.105998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-4c08b343-8cc1-4ada-b64a-15bf5b4b7c2f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:29.106596 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-4c08b343-8cc1-4ada-b64a-15bf5b4b7c2f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:29.113451 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4c08b343-8cc1-4ada-b64a-15bf5b4b7c2f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:29.113919 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4c08b343-8cc1-4ada-b64a-15bf5b4b7c2f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:29.114374 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4c08b343-8cc1-4ada-b64a-15bf5b4b7c2f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:29.115068 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4c08b343-8cc1-4ada-b64a-15bf5b4b7c2f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:29.115510 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4c08b343-8cc1-4ada-b64a-15bf5b4b7c2f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:29.115924 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4c08b343-8cc1-4ada-b64a-15bf5b4b7c2f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:29.240963 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-4c08b343-8cc1-4ada-b64a-15bf5b4b7c2f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:29.248587 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-4c08b343-8cc1-4ada-b64a-15bf5b4b7c2f tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1691 microversion: 2.1 time: 0.146479 Aug 17 07:31:29.249144 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 290/588] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:29 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1691 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:30.269092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-dd5188ff-0392-4bb7-a361-0643b80254eb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:30.269696 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-dd5188ff-0392-4bb7-a361-0643b80254eb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:30.276066 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dd5188ff-0392-4bb7-a361-0643b80254eb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:30.276538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dd5188ff-0392-4bb7-a361-0643b80254eb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:30.276976 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dd5188ff-0392-4bb7-a361-0643b80254eb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:30.277752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dd5188ff-0392-4bb7-a361-0643b80254eb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:30.278226 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dd5188ff-0392-4bb7-a361-0643b80254eb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:30.278723 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dd5188ff-0392-4bb7-a361-0643b80254eb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:30.414966 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-dd5188ff-0392-4bb7-a361-0643b80254eb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:30.422479 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-dd5188ff-0392-4bb7-a361-0643b80254eb tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1691 microversion: 2.1 time: 0.157815 Aug 17 07:31:30.423560 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 299/589] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:30 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:31.443795 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c997eba1-dd0d-4b6b-830c-377357ac4170 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:31.444408 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c997eba1-dd0d-4b6b-830c-377357ac4170 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:31.450872 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c997eba1-dd0d-4b6b-830c-377357ac4170 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:31.451354 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c997eba1-dd0d-4b6b-830c-377357ac4170 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:31.451793 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c997eba1-dd0d-4b6b-830c-377357ac4170 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:31.452485 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c997eba1-dd0d-4b6b-830c-377357ac4170 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:31.452941 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c997eba1-dd0d-4b6b-830c-377357ac4170 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:31.453368 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c997eba1-dd0d-4b6b-830c-377357ac4170 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:31.517616 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c997eba1-dd0d-4b6b-830c-377357ac4170 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:31.525341 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c997eba1-dd0d-4b6b-830c-377357ac4170 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 200 len: 1623 microversion: 2.1 time: 0.085408 Aug 17 07:31:31.526135 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 291/590] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:31 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 1623 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:31.739556 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-f0183e1b-e3e1-48e6-8763-aff30f05406c req-b0a460cd-f1db-4a09-8eb3-c855f9967437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f58c6a6-fa9c-4795-97c2-525c1510124b", "name": "network-vif-deleted", "tag": "0799a736-86ba-40d5-8200-f99f2281e899"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:31:31.750522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-f0183e1b-e3e1-48e6-8763-aff30f05406c req-b0a460cd-f1db-4a09-8eb3-c855f9967437 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:31.750937 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-f0183e1b-e3e1-48e6-8763-aff30f05406c req-b0a460cd-f1db-4a09-8eb3-c855f9967437 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:31.751905 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-f0183e1b-e3e1-48e6-8763-aff30f05406c req-b0a460cd-f1db-4a09-8eb3-c855f9967437 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:31.763286 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-f0183e1b-e3e1-48e6-8763-aff30f05406c req-b0a460cd-f1db-4a09-8eb3-c855f9967437 service nova] Creating event network-vif-deleted:0799a736-86ba-40d5-8200-f99f2281e899 for instance 1f58c6a6-fa9c-4795-97c2-525c1510124b on hv-cinder-85312 Aug 17 07:31:31.768904 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-f0183e1b-e3e1-48e6-8763-aff30f05406c req-b0a460cd-f1db-4a09-8eb3-c855f9967437 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033281 Aug 17 07:31:31.769592 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 300/591] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:31:32.547090 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-afc61555-11ed-4aa6-ae46-ea134bf75969 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:32.547801 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-afc61555-11ed-4aa6-ae46-ea134bf75969 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 1f58c6a6-fa9c-4795-97c2-525c1510124b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:32.554726 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-afc61555-11ed-4aa6-ae46-ea134bf75969 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:32.555213 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-afc61555-11ed-4aa6-ae46-ea134bf75969 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:32.555652 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-afc61555-11ed-4aa6-ae46-ea134bf75969 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:32.556380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-afc61555-11ed-4aa6-ae46-ea134bf75969 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:32.556840 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-afc61555-11ed-4aa6-ae46-ea134bf75969 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:32.557538 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-afc61555-11ed-4aa6-ae46-ea134bf75969 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:32.574933 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-afc61555-11ed-4aa6-ae46-ea134bf75969 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] HTTP exception thrown: Instance 1f58c6a6-fa9c-4795-97c2-525c1510124b could not be found. Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-afc61555-11ed-4aa6-ae46-ea134bf75969 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Request method failure captured: Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b HTTP/1.1 Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JhF5-28creqGjzJ0w0FxfPIBrCoALS6gQ2HtbOL3lJ0gLFx-dck1PDzbYwQcX2lNejuqyWG7p1bT6QmRlBuXmZgoEKIvihIfqvjPN4OpTNbaW9hBDO8GuDNGgy1UgRxXva9ZNQGdNRx4F3DMiBLL_i8w2oipQ2U63hj19PBJYA7bhU Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 177d0707c9d1494abc77c714e31fa15f Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-901876947 Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:31:32.576620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:31:32.578040 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_177d0707c9d1494abc77c714e31fa15f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/177d0707c9d1494abc77c714e31fa15f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/177d0707c9d1494abc77c714e31fa15f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/177d0707c9d1494abc77c714e31fa15f"}]}] Aug 17 07:31:32.578040 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-ServerRescueNegativeTestJSON-901876947 Aug 17 07:31:32.578040 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 177d0707c9d1494abc77c714e31fa15f Aug 17 07:31:32.578040 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-901876947 Aug 17 07:31:32.578040 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-ServerRescueNegativeTestJSON-901876947-project Aug 17 07:31:32.578040 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:31:32.578040 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:31:32.578040 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: be489ecec19847829df7c4488986373e Aug 17 07:31:32.578040 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-ServerRescueNegativeTestJSON-901876947-project Aug 17 07:31:32.578040 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:31:32.578040 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance 1f58c6a6-fa9c-4795-97c2-525c1510124b could not be found. Aug 17 07:31:32.578040 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': '1f58c6a6-fa9c-4795-97c2-525c1510124b'} Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f58c6a6-fa9c-4795-97c2-525c1510124b could not be found. Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:31:32.579166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:31:32.582251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:31:32.582251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:31:32.582251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:31:32.582251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:31:32.582251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:31:32.582251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:31:32.582251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:31:32.582251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f58c6a6-fa9c-4795-97c2-525c1510124b could not be found. Aug 17 07:31:32.582251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:32.582251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:31:32.582251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:32.582251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:31:32.582251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:31:32.582251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:31:32.582251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:31:32.582251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:31:32.582251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f58c6a6-fa9c-4795-97c2-525c1510124b could not be found. Aug 17 07:31:32.582251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:32.584728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-afc61555-11ed-4aa6-ae46-ea134bf75969 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Returning 404 to user: Instance 1f58c6a6-fa9c-4795-97c2-525c1510124b could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:31:32.584728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-afc61555-11ed-4aa6-ae46-ea134bf75969 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b" status: 404 len: 111 microversion: 2.1 time: 0.034798 Aug 17 07:31:32.584728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 292/592] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:32 2022] GET /compute/v2.1/servers/1f58c6a6-fa9c-4795-97c2-525c1510124b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:31:32.587647 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-72c23c9e-5ae0-4031-943a-d5feb116cb37 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '.version_select at 0x7f30ac260ca0>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:32.606674 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-72c23c9e-5ae0-4031-943a-d5feb116cb37 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-485856723" status: 202 len: 0 microversion: 2.1 time: 0.023003 Aug 17 07:31:32.607277 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 301/593] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Aug 17 07:31:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-485856723 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:31:35.482747 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-eb7d9caa-01f7-4c90-8e37-0705a050dc62 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:35.483258 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-eb7d9caa-01f7-4c90-8e37-0705a050dc62 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:35.490339 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-eb7d9caa-01f7-4c90-8e37-0705a050dc62 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:35.490818 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-eb7d9caa-01f7-4c90-8e37-0705a050dc62 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:35.491257 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-eb7d9caa-01f7-4c90-8e37-0705a050dc62 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:35.491946 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-eb7d9caa-01f7-4c90-8e37-0705a050dc62 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:35.492652 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-eb7d9caa-01f7-4c90-8e37-0705a050dc62 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:35.493077 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-eb7d9caa-01f7-4c90-8e37-0705a050dc62 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:35.518772 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-eb7d9caa-01f7-4c90-8e37-0705a050dc62 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Going to try to terminate instance {{(pid=120834) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:31:35.541706 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:35.593796 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-eb7d9caa-01f7-4c90-8e37-0705a050dc62 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "DELETE /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 204 len: 0 microversion: 2.1 time: 0.114584 Aug 17 07:31:35.594428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 293/594] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:31:35 2022] DELETE /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:31:35.603924 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-0d6c3d31-3c4c-4f9d-a47d-e11811329196 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:35.604611 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-0d6c3d31-3c4c-4f9d-a47d-e11811329196 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:35.610711 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0d6c3d31-3c4c-4f9d-a47d-e11811329196 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:35.611187 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0d6c3d31-3c4c-4f9d-a47d-e11811329196 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:35.611659 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0d6c3d31-3c4c-4f9d-a47d-e11811329196 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:35.612358 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0d6c3d31-3c4c-4f9d-a47d-e11811329196 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:35.612813 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0d6c3d31-3c4c-4f9d-a47d-e11811329196 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:35.613236 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0d6c3d31-3c4c-4f9d-a47d-e11811329196 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:35.744065 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-0d6c3d31-3c4c-4f9d-a47d-e11811329196 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:35.751414 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-0d6c3d31-3c4c-4f9d-a47d-e11811329196 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1509 microversion: 2.1 time: 0.152287 Aug 17 07:31:35.751973 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 302/595] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:35 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:36.773059 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7052e07d-5b60-4eda-a748-8aa6941af0e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:36.773754 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-7052e07d-5b60-4eda-a748-8aa6941af0e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:36.780111 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7052e07d-5b60-4eda-a748-8aa6941af0e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:36.780583 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7052e07d-5b60-4eda-a748-8aa6941af0e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:36.781014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7052e07d-5b60-4eda-a748-8aa6941af0e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:36.781696 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7052e07d-5b60-4eda-a748-8aa6941af0e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:36.782178 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7052e07d-5b60-4eda-a748-8aa6941af0e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:36.782620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7052e07d-5b60-4eda-a748-8aa6941af0e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:36.911584 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-7052e07d-5b60-4eda-a748-8aa6941af0e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:36.918896 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-7052e07d-5b60-4eda-a748-8aa6941af0e9 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1509 microversion: 2.1 time: 0.150033 Aug 17 07:31:36.919487 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 294/596] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:36 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:37.940886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-af82ae1b-95ae-41f0-b4be-e5614f146d6e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:37.941497 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-af82ae1b-95ae-41f0-b4be-e5614f146d6e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:37.947985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-af82ae1b-95ae-41f0-b4be-e5614f146d6e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:37.948464 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-af82ae1b-95ae-41f0-b4be-e5614f146d6e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:37.948904 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-af82ae1b-95ae-41f0-b4be-e5614f146d6e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:37.949588 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-af82ae1b-95ae-41f0-b4be-e5614f146d6e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:37.950100 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-af82ae1b-95ae-41f0-b4be-e5614f146d6e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:37.950536 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-af82ae1b-95ae-41f0-b4be-e5614f146d6e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:38.080884 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-af82ae1b-95ae-41f0-b4be-e5614f146d6e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:38.083215 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:38.090550 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-af82ae1b-95ae-41f0-b4be-e5614f146d6e tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1509 microversion: 2.1 time: 0.154000 Aug 17 07:31:38.091120 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 303/597] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:37 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:38.769285 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-caa6254f-080b-4e87-b11f-765d39b04945 req-ea33e64c-9483-423b-a711-c9667072bc79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0f55a4-d90a-443c-85c1-37216c95aa7a", "name": "network-vif-deleted", "tag": "60c1b470-3d85-4b92-8000-58ca0fee2484"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:31:38.782874 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-caa6254f-080b-4e87-b11f-765d39b04945 req-ea33e64c-9483-423b-a711-c9667072bc79 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:38.784569 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-caa6254f-080b-4e87-b11f-765d39b04945 req-ea33e64c-9483-423b-a711-c9667072bc79 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:38.785000 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-caa6254f-080b-4e87-b11f-765d39b04945 req-ea33e64c-9483-423b-a711-c9667072bc79 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:38.796585 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-caa6254f-080b-4e87-b11f-765d39b04945 req-ea33e64c-9483-423b-a711-c9667072bc79 service nova] Creating event network-vif-deleted:60c1b470-3d85-4b92-8000-58ca0fee2484 for instance bf0f55a4-d90a-443c-85c1-37216c95aa7a on hv-cinder-85312 Aug 17 07:31:38.801276 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-caa6254f-080b-4e87-b11f-765d39b04945 req-ea33e64c-9483-423b-a711-c9667072bc79 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037773 Aug 17 07:31:38.802260 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 295/598] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:31:39.111680 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-6dce9d17-d3ff-4ba5-82c6-0a13d76d5499 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:39.112301 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-6dce9d17-d3ff-4ba5-82c6-0a13d76d5499 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:39.120433 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6dce9d17-d3ff-4ba5-82c6-0a13d76d5499 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:39.120925 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6dce9d17-d3ff-4ba5-82c6-0a13d76d5499 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:39.121365 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6dce9d17-d3ff-4ba5-82c6-0a13d76d5499 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:39.122104 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6dce9d17-d3ff-4ba5-82c6-0a13d76d5499 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:39.122570 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6dce9d17-d3ff-4ba5-82c6-0a13d76d5499 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:39.123003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6dce9d17-d3ff-4ba5-82c6-0a13d76d5499 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:39.156068 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6dce9d17-d3ff-4ba5-82c6-0a13d76d5499 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:39.156668 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6dce9d17-d3ff-4ba5-82c6-0a13d76d5499 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:39.156981 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6dce9d17-d3ff-4ba5-82c6-0a13d76d5499 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:39.157437 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.objects.instance [None req-6dce9d17-d3ff-4ba5-82c6-0a13d76d5499 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lazy-loading 'fault' on Instance uuid bf0f55a4-d90a-443c-85c1-37216c95aa7a {{(pid=120835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:31:39.198085 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-6dce9d17-d3ff-4ba5-82c6-0a13d76d5499 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:39.206428 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-6dce9d17-d3ff-4ba5-82c6-0a13d76d5499 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 200 len: 1312 microversion: 2.1 time: 0.098874 Aug 17 07:31:39.207005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 304/599] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:39 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:40.228329 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-fdeaf97f-2e75-4bb6-b7d3-09828bf6a056 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:40.229043 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-fdeaf97f-2e75-4bb6-b7d3-09828bf6a056 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: bf0f55a4-d90a-443c-85c1-37216c95aa7a] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:40.235163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fdeaf97f-2e75-4bb6-b7d3-09828bf6a056 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:40.235633 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fdeaf97f-2e75-4bb6-b7d3-09828bf6a056 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:40.236062 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fdeaf97f-2e75-4bb6-b7d3-09828bf6a056 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:40.236751 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fdeaf97f-2e75-4bb6-b7d3-09828bf6a056 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:40.237200 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fdeaf97f-2e75-4bb6-b7d3-09828bf6a056 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:40.237621 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fdeaf97f-2e75-4bb6-b7d3-09828bf6a056 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:40.250663 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-fdeaf97f-2e75-4bb6-b7d3-09828bf6a056 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] HTTP exception thrown: Instance bf0f55a4-d90a-443c-85c1-37216c95aa7a could not be found. Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-fdeaf97f-2e75-4bb6-b7d3-09828bf6a056 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Request method failure captured: Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a HTTP/1.1 Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JhF5-28creqGjzJ0w0FxfPIBrCoALS6gQ2HtbOL3lJ0gLFx-dck1PDzbYwQcX2lNejuqyWG7p1bT6QmRlBuXmZgoEKIvihIfqvjPN4OpTNbaW9hBDO8GuDNGgy1UgRxXva9ZNQGdNRx4F3DMiBLL_i8w2oipQ2U63hj19PBJYA7bhU Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 177d0707c9d1494abc77c714e31fa15f Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-901876947 Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:31:40.252234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:31:40.253831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_177d0707c9d1494abc77c714e31fa15f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/177d0707c9d1494abc77c714e31fa15f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/177d0707c9d1494abc77c714e31fa15f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/177d0707c9d1494abc77c714e31fa15f"}]}] Aug 17 07:31:40.253831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-ServerRescueNegativeTestJSON-901876947 Aug 17 07:31:40.253831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 177d0707c9d1494abc77c714e31fa15f Aug 17 07:31:40.253831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-901876947 Aug 17 07:31:40.253831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-ServerRescueNegativeTestJSON-901876947-project Aug 17 07:31:40.253831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:31:40.253831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:31:40.253831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: be489ecec19847829df7c4488986373e Aug 17 07:31:40.253831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-ServerRescueNegativeTestJSON-901876947-project Aug 17 07:31:40.253831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:31:40.253831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance bf0f55a4-d90a-443c-85c1-37216c95aa7a could not be found. Aug 17 07:31:40.253831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': 'bf0f55a4-d90a-443c-85c1-37216c95aa7a'} Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf0f55a4-d90a-443c-85c1-37216c95aa7a could not be found. Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:31:40.254911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:31:40.256482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:31:40.256482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:31:40.256482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:31:40.256482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:31:40.256482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:31:40.256482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:31:40.256482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:31:40.256482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf0f55a4-d90a-443c-85c1-37216c95aa7a could not be found. Aug 17 07:31:40.256482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:40.256482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:31:40.256482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:40.256482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:31:40.256482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:31:40.256482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:31:40.256482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:31:40.256482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:31:40.256482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf0f55a4-d90a-443c-85c1-37216c95aa7a could not be found. Aug 17 07:31:40.256482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:40.257988 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-fdeaf97f-2e75-4bb6-b7d3-09828bf6a056 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Returning 404 to user: Instance bf0f55a4-d90a-443c-85c1-37216c95aa7a could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:31:40.257988 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-fdeaf97f-2e75-4bb6-b7d3-09828bf6a056 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a" status: 404 len: 111 microversion: 2.1 time: 0.029976 Aug 17 07:31:40.257988 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 296/600] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:40 2022] GET /compute/v2.1/servers/bf0f55a4-d90a-443c-85c1-37216c95aa7a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:31:40.262046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c83c550f-2776-45da-8e2f-8faeb9f32b40 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:40.262537 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-c83c550f-2776-45da-8e2f-8faeb9f32b40 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:40.269402 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c83c550f-2776-45da-8e2f-8faeb9f32b40 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:40.269870 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c83c550f-2776-45da-8e2f-8faeb9f32b40 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:40.270331 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c83c550f-2776-45da-8e2f-8faeb9f32b40 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:40.271009 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c83c550f-2776-45da-8e2f-8faeb9f32b40 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:40.271452 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c83c550f-2776-45da-8e2f-8faeb9f32b40 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:40.271867 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c83c550f-2776-45da-8e2f-8faeb9f32b40 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:40.296196 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-c83c550f-2776-45da-8e2f-8faeb9f32b40 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Going to try to terminate instance {{(pid=120835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:31:40.375083 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-c83c550f-2776-45da-8e2f-8faeb9f32b40 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "DELETE /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 204 len: 0 microversion: 2.1 time: 0.116467 Aug 17 07:31:40.375704 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 305/601] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:31:40 2022] DELETE /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:31:40.383971 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-219a3998-f3e8-4cb7-944a-fc484f0ea616 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:40.384576 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-219a3998-f3e8-4cb7-944a-fc484f0ea616 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:40.390557 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-219a3998-f3e8-4cb7-944a-fc484f0ea616 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:40.391038 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-219a3998-f3e8-4cb7-944a-fc484f0ea616 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:40.391473 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-219a3998-f3e8-4cb7-944a-fc484f0ea616 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:40.392163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-219a3998-f3e8-4cb7-944a-fc484f0ea616 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:40.393122 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-219a3998-f3e8-4cb7-944a-fc484f0ea616 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:40.393547 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-219a3998-f3e8-4cb7-944a-fc484f0ea616 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:40.521406 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-219a3998-f3e8-4cb7-944a-fc484f0ea616 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:40.528865 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-219a3998-f3e8-4cb7-944a-fc484f0ea616 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.148941 Aug 17 07:31:40.529418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 297/602] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:40 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:31:41.551021 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d2d350f5-202c-4b89-a480-e9cf2e675983 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:41.551715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d2d350f5-202c-4b89-a480-e9cf2e675983 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:41.558019 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d2d350f5-202c-4b89-a480-e9cf2e675983 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:41.558491 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d2d350f5-202c-4b89-a480-e9cf2e675983 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:41.558928 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d2d350f5-202c-4b89-a480-e9cf2e675983 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:41.559598 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d2d350f5-202c-4b89-a480-e9cf2e675983 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:41.560042 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d2d350f5-202c-4b89-a480-e9cf2e675983 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:41.560459 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d2d350f5-202c-4b89-a480-e9cf2e675983 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:41.900044 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d2d350f5-202c-4b89-a480-e9cf2e675983 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:41.907324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d2d350f5-202c-4b89-a480-e9cf2e675983 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.361274 Aug 17 07:31:41.907881 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 306/603] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:41 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:42.929374 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c7f608ea-f938-4184-a70e-2eb652f2e358 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:42.929995 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c7f608ea-f938-4184-a70e-2eb652f2e358 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:42.936440 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c7f608ea-f938-4184-a70e-2eb652f2e358 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:42.936940 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c7f608ea-f938-4184-a70e-2eb652f2e358 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:42.937377 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c7f608ea-f938-4184-a70e-2eb652f2e358 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:42.938094 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c7f608ea-f938-4184-a70e-2eb652f2e358 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:42.938548 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c7f608ea-f938-4184-a70e-2eb652f2e358 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:42.938971 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c7f608ea-f938-4184-a70e-2eb652f2e358 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:43.062402 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c7f608ea-f938-4184-a70e-2eb652f2e358 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:43.069716 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c7f608ea-f938-4184-a70e-2eb652f2e358 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.144211 Aug 17 07:31:43.070301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 298/604] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:42 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:44.090984 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-24695bc9-0734-475e-94e3-b78e775f4811 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:44.091599 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-24695bc9-0734-475e-94e3-b78e775f4811 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:44.098066 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-24695bc9-0734-475e-94e3-b78e775f4811 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:44.098546 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-24695bc9-0734-475e-94e3-b78e775f4811 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:44.098989 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-24695bc9-0734-475e-94e3-b78e775f4811 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:44.099676 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-24695bc9-0734-475e-94e3-b78e775f4811 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:44.100131 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-24695bc9-0734-475e-94e3-b78e775f4811 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:44.100558 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-24695bc9-0734-475e-94e3-b78e775f4811 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:44.287365 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-24695bc9-0734-475e-94e3-b78e775f4811 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be489ecec19847829df7c4488986373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '177d0707c9d1494abc77c714e31fa15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:44.294796 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-24695bc9-0734-475e-94e3-b78e775f4811 tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 200 len: 1521 microversion: 2.1 time: 0.207644 Aug 17 07:31:44.295369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 307/605] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:44 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:44.591330 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-5ef60f54-53e0-46f1-87d0-d9b85cc1e336 req-84e288ea-4efb-4a8f-8c4c-1a6428bf1eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479d4f33-9d2a-4cec-84c9-18c739e2374f", "name": "network-vif-deleted", "tag": "3605db22-3f80-4c4c-927b-ba43e6ba88ef"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:31:44.601907 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-5ef60f54-53e0-46f1-87d0-d9b85cc1e336 req-84e288ea-4efb-4a8f-8c4c-1a6428bf1eec service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:44.602415 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-5ef60f54-53e0-46f1-87d0-d9b85cc1e336 req-84e288ea-4efb-4a8f-8c4c-1a6428bf1eec service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:44.602900 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-5ef60f54-53e0-46f1-87d0-d9b85cc1e336 req-84e288ea-4efb-4a8f-8c4c-1a6428bf1eec service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:44.614493 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-5ef60f54-53e0-46f1-87d0-d9b85cc1e336 req-84e288ea-4efb-4a8f-8c4c-1a6428bf1eec service nova] Creating event network-vif-deleted:3605db22-3f80-4c4c-927b-ba43e6ba88ef for instance 479d4f33-9d2a-4cec-84c9-18c739e2374f on hv-cinder-85312 Aug 17 07:31:44.619387 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-5ef60f54-53e0-46f1-87d0-d9b85cc1e336 req-84e288ea-4efb-4a8f-8c4c-1a6428bf1eec service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031859 Aug 17 07:31:44.619973 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 299/606] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:31:45.316634 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-99e6a4ac-d2a7-46db-ba65-44731f35f58b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:45.317236 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-99e6a4ac-d2a7-46db-ba65-44731f35f58b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] [instance: 479d4f33-9d2a-4cec-84c9-18c739e2374f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:45.323590 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-99e6a4ac-d2a7-46db-ba65-44731f35f58b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:45.324063 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-99e6a4ac-d2a7-46db-ba65-44731f35f58b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:45.324494 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-99e6a4ac-d2a7-46db-ba65-44731f35f58b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:45.325170 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-99e6a4ac-d2a7-46db-ba65-44731f35f58b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:45.325618 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-99e6a4ac-d2a7-46db-ba65-44731f35f58b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:45.326069 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-99e6a4ac-d2a7-46db-ba65-44731f35f58b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:45.339659 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-99e6a4ac-d2a7-46db-ba65-44731f35f58b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] HTTP exception thrown: Instance 479d4f33-9d2a-4cec-84c9-18c739e2374f could not be found. Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-99e6a4ac-d2a7-46db-ba65-44731f35f58b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Request method failure captured: Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f HTTP/1.1 Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JhF5-28creqGjzJ0w0FxfPIBrCoALS6gQ2HtbOL3lJ0gLFx-dck1PDzbYwQcX2lNejuqyWG7p1bT6QmRlBuXmZgoEKIvihIfqvjPN4OpTNbaW9hBDO8GuDNGgy1UgRxXva9ZNQGdNRx4F3DMiBLL_i8w2oipQ2U63hj19PBJYA7bhU Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 177d0707c9d1494abc77c714e31fa15f Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-901876947 Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:31:45.341257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:31:45.342752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_177d0707c9d1494abc77c714e31fa15f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/177d0707c9d1494abc77c714e31fa15f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/177d0707c9d1494abc77c714e31fa15f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/177d0707c9d1494abc77c714e31fa15f"}]}] Aug 17 07:31:45.342752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-ServerRescueNegativeTestJSON-901876947 Aug 17 07:31:45.342752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 177d0707c9d1494abc77c714e31fa15f Aug 17 07:31:45.342752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-901876947 Aug 17 07:31:45.342752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-ServerRescueNegativeTestJSON-901876947-project Aug 17 07:31:45.342752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:31:45.342752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:31:45.342752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: be489ecec19847829df7c4488986373e Aug 17 07:31:45.342752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-ServerRescueNegativeTestJSON-901876947-project Aug 17 07:31:45.342752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:31:45.342752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance 479d4f33-9d2a-4cec-84c9-18c739e2374f could not be found. Aug 17 07:31:45.342752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': '479d4f33-9d2a-4cec-84c9-18c739e2374f'} Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 479d4f33-9d2a-4cec-84c9-18c739e2374f could not be found. Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:31:45.343678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:31:45.345155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:31:45.345155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:31:45.345155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:31:45.345155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:31:45.345155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:31:45.345155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:31:45.345155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:31:45.345155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 479d4f33-9d2a-4cec-84c9-18c739e2374f could not be found. Aug 17 07:31:45.345155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:31:45.345155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:31:45.345155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:31:45.345155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:31:45.345155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:31:45.345155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:31:45.345155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:31:45.345155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:31:45.345155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 479d4f33-9d2a-4cec-84c9-18c739e2374f could not be found. Aug 17 07:31:45.345155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:31:45.346755 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-99e6a4ac-d2a7-46db-ba65-44731f35f58b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] Returning 404 to user: Instance 479d4f33-9d2a-4cec-84c9-18c739e2374f could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:31:45.346755 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-99e6a4ac-d2a7-46db-ba65-44731f35f58b tempest-ServerRescueNegativeTestJSON-901876947 tempest-ServerRescueNegativeTestJSON-901876947-project] 10.222.0.45 "GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f" status: 404 len: 111 microversion: 2.1 time: 0.030395 Aug 17 07:31:45.346755 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 308/607] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:45 2022] GET /compute/v2.1/servers/479d4f33-9d2a-4cec-84c9-18c739e2374f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:31:49.304420 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-93b6a487-9ee3-4fb2-a847-7e8932cc1ff3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:49.304988 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-93b6a487-9ee3-4fb2-a847-7e8932cc1ff3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:49.311054 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-93b6a487-9ee3-4fb2-a847-7e8932cc1ff3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:49.311526 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-93b6a487-9ee3-4fb2-a847-7e8932cc1ff3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:49.311954 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-93b6a487-9ee3-4fb2-a847-7e8932cc1ff3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:49.312655 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-93b6a487-9ee3-4fb2-a847-7e8932cc1ff3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:49.313171 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-93b6a487-9ee3-4fb2-a847-7e8932cc1ff3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:49.313502 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-93b6a487-9ee3-4fb2-a847-7e8932cc1ff3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:49.339807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-93b6a487-9ee3-4fb2-a847-7e8932cc1ff3 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b/ips" status: 200 len: 150 microversion: 2.1 time: 0.040737 Aug 17 07:31:49.340385 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 300/608] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 17 07:31:49 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:31:50.694166 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2a5dfe50-397c-467c-9e8b-ca0702580fd8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90f797b1-e932-4351-8386-5ab16a0711c0"}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:31:50.696529 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-2a5dfe50-397c-467c-9e8b-ca0702580fd8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:50.702705 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a5dfe50-397c-467c-9e8b-ca0702580fd8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:50.703178 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a5dfe50-397c-467c-9e8b-ca0702580fd8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:50.703898 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a5dfe50-397c-467c-9e8b-ca0702580fd8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:50.704649 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a5dfe50-397c-467c-9e8b-ca0702580fd8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:50.705126 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a5dfe50-397c-467c-9e8b-ca0702580fd8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:50.705821 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a5dfe50-397c-467c-9e8b-ca0702580fd8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:50.945364 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-2a5dfe50-397c-467c-9e8b-ca0702580fd8 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "POST /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255579 Aug 17 07:31:50.945990 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 309/609] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 17 07:31:50 2022] POST /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:31:51.451304 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-63b79114-3fec-4926-b1f6-8358028b226d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:51.451828 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-63b79114-3fec-4926-b1f6-8358028b226d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:51.458829 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-63b79114-3fec-4926-b1f6-8358028b226d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:51.459305 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-63b79114-3fec-4926-b1f6-8358028b226d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:51.459743 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-63b79114-3fec-4926-b1f6-8358028b226d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:51.460429 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-63b79114-3fec-4926-b1f6-8358028b226d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:51.460885 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-63b79114-3fec-4926-b1f6-8358028b226d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:51.461311 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-63b79114-3fec-4926-b1f6-8358028b226d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:51.487291 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-63b79114-3fec-4926-b1f6-8358028b226d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Going to try to terminate instance {{(pid=120834) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:31:51.559525 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-63b79114-3fec-4926-b1f6-8358028b226d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 204 len: 0 microversion: 2.1 time: 0.111837 Aug 17 07:31:51.560100 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 301/610] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:31:51 2022] DELETE /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:31:51.572513 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ac1c9916-fecd-4d47-9b4c-3ac86f0b247f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:51.573228 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-ac1c9916-fecd-4d47-9b4c-3ac86f0b247f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:51.579763 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ac1c9916-fecd-4d47-9b4c-3ac86f0b247f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:51.580769 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ac1c9916-fecd-4d47-9b4c-3ac86f0b247f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:51.581374 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ac1c9916-fecd-4d47-9b4c-3ac86f0b247f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:51.582081 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ac1c9916-fecd-4d47-9b4c-3ac86f0b247f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:51.582532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ac1c9916-fecd-4d47-9b4c-3ac86f0b247f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:51.583028 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ac1c9916-fecd-4d47-9b4c-3ac86f0b247f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:51.719585 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ac1c9916-fecd-4d47-9b4c-3ac86f0b247f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:51.727123 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-ac1c9916-fecd-4d47-9b4c-3ac86f0b247f tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1575 microversion: 2.1 time: 0.161880 Aug 17 07:31:51.727691 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 310/611] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:51 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:52.749640 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-231b6370-0384-4130-a606-10ec3214dc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:52.750435 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-231b6370-0384-4130-a606-10ec3214dc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:52.756656 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-231b6370-0384-4130-a606-10ec3214dc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:52.757127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-231b6370-0384-4130-a606-10ec3214dc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:52.757552 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-231b6370-0384-4130-a606-10ec3214dc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:52.758256 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-231b6370-0384-4130-a606-10ec3214dc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:52.758707 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-231b6370-0384-4130-a606-10ec3214dc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:52.759118 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-231b6370-0384-4130-a606-10ec3214dc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:53.052382 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-231b6370-0384-4130-a606-10ec3214dc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:53.059917 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-231b6370-0384-4130-a606-10ec3214dc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1575 microversion: 2.1 time: 0.314618 Aug 17 07:31:53.060552 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 302/612] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:52 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1575 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:54.082098 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3f1b84cb-87c4-408d-a711-e8f30856dd4b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:54.083050 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-3f1b84cb-87c4-408d-a711-e8f30856dd4b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:54.089872 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3f1b84cb-87c4-408d-a711-e8f30856dd4b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:54.090393 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3f1b84cb-87c4-408d-a711-e8f30856dd4b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:54.090821 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3f1b84cb-87c4-408d-a711-e8f30856dd4b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:54.091506 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3f1b84cb-87c4-408d-a711-e8f30856dd4b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:54.091952 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3f1b84cb-87c4-408d-a711-e8f30856dd4b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:54.092372 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3f1b84cb-87c4-408d-a711-e8f30856dd4b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:54.159480 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-4d628589-5eb7-4037-9819-22d02c5823b4 req-c450621c-d5f9-489b-ba1f-b26a34786b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da23597a-1e52-4e8a-bd7b-28bd175471ae", "name": "network-vif-deleted", "tag": "38d23e53-70d4-4b98-ae25-a473ae03bd51"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:31:54.165006 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:54.175756 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-4d628589-5eb7-4037-9819-22d02c5823b4 req-c450621c-d5f9-489b-ba1f-b26a34786b57 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:54.176237 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-4d628589-5eb7-4037-9819-22d02c5823b4 req-c450621c-d5f9-489b-ba1f-b26a34786b57 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:54.176668 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-4d628589-5eb7-4037-9819-22d02c5823b4 req-c450621c-d5f9-489b-ba1f-b26a34786b57 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:54.191152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-3f1b84cb-87c4-408d-a711-e8f30856dd4b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:54.194999 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-4d628589-5eb7-4037-9819-22d02c5823b4 req-c450621c-d5f9-489b-ba1f-b26a34786b57 service nova] Creating event network-vif-deleted:38d23e53-70d4-4b98-ae25-a473ae03bd51 for instance da23597a-1e52-4e8a-bd7b-28bd175471ae on hv-cinder-85312 Aug 17 07:31:54.200133 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-4d628589-5eb7-4037-9819-22d02c5823b4 req-c450621c-d5f9-489b-ba1f-b26a34786b57 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044770 Aug 17 07:31:54.200919 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 303/613] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:31:54.211287 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-3f1b84cb-87c4-408d-a711-e8f30856dd4b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 200 len: 1508 microversion: 2.1 time: 0.134183 Aug 17 07:31:54.211879 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 311/614] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:54 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 1508 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:55.235130 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a0571c9b-9d46-4e13-970c-4abb3dd59254 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:55.235824 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-a0571c9b-9d46-4e13-970c-4abb3dd59254 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:55.242699 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a0571c9b-9d46-4e13-970c-4abb3dd59254 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:55.243177 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a0571c9b-9d46-4e13-970c-4abb3dd59254 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:55.243611 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a0571c9b-9d46-4e13-970c-4abb3dd59254 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:55.244299 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a0571c9b-9d46-4e13-970c-4abb3dd59254 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:55.244749 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a0571c9b-9d46-4e13-970c-4abb3dd59254 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:55.245172 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a0571c9b-9d46-4e13-970c-4abb3dd59254 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:55.259291 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-a0571c9b-9d46-4e13-970c-4abb3dd59254 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] HTTP exception thrown: Instance da23597a-1e52-4e8a-bd7b-28bd175471ae could not be found. Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a0571c9b-9d46-4e13-970c-4abb3dd59254 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Request method failure captured: Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae HTTP/1.1 Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JiGZ4T_dzKDjkBCfxbYu3SMuCbXeL9GtrJz4d6Vgz1o2CVvzQTZQ3Z03-yrHmJoojTNWPa7Fyn6tiiPKyLQVpPI6Rcs17J01gqFySOeGI2AajATYblkh1Mm2kzJrmI7RZ-O5R8PMtKAZdvXPwfXv80M8Oer1Cr8HncocvyrtFJFi3Y Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: afb93daca17c466da3a698536c6b323f Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-TestVolumeBootPattern-104542181 Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:31:55.260927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:31:55.262778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_afb93daca17c466da3a698536c6b323f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/afb93daca17c466da3a698536c6b323f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afb93daca17c466da3a698536c6b323f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afb93daca17c466da3a698536c6b323f"}]}] Aug 17 07:31:55.262778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-TestVolumeBootPattern-104542181 Aug 17 07:31:55.262778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: afb93daca17c466da3a698536c6b323f Aug 17 07:31:55.262778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-TestVolumeBootPattern-104542181 Aug 17 07:31:55.262778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-TestVolumeBootPattern-104542181-project Aug 17 07:31:55.262778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:31:55.262778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:31:55.262778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: b2e79830079c4aa9b95c4622bac45c74 Aug 17 07:31:55.262778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-TestVolumeBootPattern-104542181-project Aug 17 07:31:55.262778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:31:55.262778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance da23597a-1e52-4e8a-bd7b-28bd175471ae could not be found. Aug 17 07:31:55.262778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': 'da23597a-1e52-4e8a-bd7b-28bd175471ae'} Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da23597a-1e52-4e8a-bd7b-28bd175471ae could not be found. Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:31:55.263535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:31:55.265333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:31:55.265333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:31:55.265333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:31:55.265333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:31:55.265333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:31:55.265333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:31:55.265333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:31:55.265333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da23597a-1e52-4e8a-bd7b-28bd175471ae could not be found. Aug 17 07:31:55.265333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:55.265333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:31:55.265333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:55.265333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:31:55.265333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:31:55.265333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:31:55.265333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:31:55.265333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:31:55.265333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da23597a-1e52-4e8a-bd7b-28bd175471ae could not be found. Aug 17 07:31:55.265333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:55.266968 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a0571c9b-9d46-4e13-970c-4abb3dd59254 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Returning 404 to user: Instance da23597a-1e52-4e8a-bd7b-28bd175471ae could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:31:55.266968 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a0571c9b-9d46-4e13-970c-4abb3dd59254 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 404 len: 111 microversion: 2.1 time: 0.032353 Aug 17 07:31:55.266968 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 304/615] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:55 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:31:55.436795 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-76687ad9-56c9-4fc3-9018-c71fa1921d5c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-793782712", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-800034190", "security_groups": [{"name": "tempest-secgroup-smoke-563096334"}], "block_device_mapping_v2": [{"uuid": "6b97012a-cb13-4933-a8b7-d64e2816586f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7da685da-5755-4a74-ae7f-f5d4d0aa3b15"}]}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:31:55.447521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:55.556817 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.network.neutron [None req-76687ad9-56c9-4fc3-9018-c71fa1921d5c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] validate_networks() for [('7da685da-5755-4a74-ae7f-f5d4d0aa3b15', None, None, None, None, None)] {{(pid=120835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:31:55.942134 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-76687ad9-56c9-4fc3-9018-c71fa1921d5c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Flavor limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:31:55.942573 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-76687ad9-56c9-4fc3-9018-c71fa1921d5c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Image limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:31:55.943076 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-76687ad9-56c9-4fc3-9018-c71fa1921d5c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Flavor pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:31:55.943478 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-76687ad9-56c9-4fc3-9018-c71fa1921d5c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Image pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:31:55.943883 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-76687ad9-56c9-4fc3-9018-c71fa1921d5c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:31:55.953092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-76687ad9-56c9-4fc3-9018-c71fa1921d5c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:55.953569 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-76687ad9-56c9-4fc3-9018-c71fa1921d5c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:55.954024 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-76687ad9-56c9-4fc3-9018-c71fa1921d5c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:55.955268 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-76687ad9-56c9-4fc3-9018-c71fa1921d5c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:55.955823 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-76687ad9-56c9-4fc3-9018-c71fa1921d5c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:55.956247 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-76687ad9-56c9-4fc3-9018-c71fa1921d5c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:55.973739 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-76687ad9-56c9-4fc3-9018-c71fa1921d5c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Getting quotas for project afb93daca17c466da3a698536c6b323f. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:31:55.978016 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-76687ad9-56c9-4fc3-9018-c71fa1921d5c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Getting quotas for user b2e79830079c4aa9b95c4622bac45c74 and project afb93daca17c466da3a698536c6b323f. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:31:56.041610 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-76687ad9-56c9-4fc3-9018-c71fa1921d5c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Going to run 1 instances... {{(pid=120835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:31:56.044262 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-76687ad9-56c9-4fc3-9018-c71fa1921d5c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b97012a-cb13-4933-a8b7-d64e2816586f',volume_size=None,volume_type=None)] {{(pid=120835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:31:56.181520 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-76687ad9-56c9-4fc3-9018-c71fa1921d5c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.748744 Aug 17 07:31:56.182200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 312/616] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:31:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 07:31:56.193775 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-4588ab9e-c580-4b57-a3fb-d88d7ebe6f53 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:56.194627 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-4588ab9e-c580-4b57-a3fb-d88d7ebe6f53 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:56.269128 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-4588ab9e-c580-4b57-a3fb-d88d7ebe6f53 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:56.276559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-4588ab9e-c580-4b57-a3fb-d88d7ebe6f53 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1093 microversion: 2.1 time: 0.087265 Aug 17 07:31:56.277345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 305/617] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:56 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1093 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:57.298553 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-6cca7dfd-8290-4690-84ab-aa30669c2448 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:57.299717 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-6cca7dfd-8290-4690-84ab-aa30669c2448 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:57.306684 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6cca7dfd-8290-4690-84ab-aa30669c2448 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:57.307169 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6cca7dfd-8290-4690-84ab-aa30669c2448 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:57.307603 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6cca7dfd-8290-4690-84ab-aa30669c2448 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:57.308646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6cca7dfd-8290-4690-84ab-aa30669c2448 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:57.309473 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6cca7dfd-8290-4690-84ab-aa30669c2448 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:57.310106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6cca7dfd-8290-4690-84ab-aa30669c2448 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:57.384210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-6cca7dfd-8290-4690-84ab-aa30669c2448 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:57.391999 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-6cca7dfd-8290-4690-84ab-aa30669c2448 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1191 microversion: 2.1 time: 0.097429 Aug 17 07:31:57.392613 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 313/618] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:57 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1191 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:57.514991 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b5221513-97b2-4419-92eb-496b8d57d3cd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90f797b1-e932-4351-8386-5ab16a0711c0"}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:31:57.517412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-b5221513-97b2-4419-92eb-496b8d57d3cd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:57.524639 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b5221513-97b2-4419-92eb-496b8d57d3cd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:57.525055 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b5221513-97b2-4419-92eb-496b8d57d3cd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:57.525484 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b5221513-97b2-4419-92eb-496b8d57d3cd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:57.526203 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b5221513-97b2-4419-92eb-496b8d57d3cd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:57.526655 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b5221513-97b2-4419-92eb-496b8d57d3cd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:57.527075 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b5221513-97b2-4419-92eb-496b8d57d3cd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:57.614272 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-b5221513-97b2-4419-92eb-496b8d57d3cd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] HTTP exception thrown: Invalid volume: volume 90f797b1-e932-4351-8386-5ab16a0711c0 is already attached to instances: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b5221513-97b2-4419-92eb-496b8d57d3cd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Request method failure captured: Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: POST /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b/os-volume_attachments HTTP/1.1 Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 74 Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JhGMmtOHPQ5tXMBLT1ZWRDn92BoL8xS5HEV9kJ9w-VnlQw7GKIuWmct0Qgt_en_280xO3qINH5E37EeabHnDI9eZ1ASkmK0KnVQ204joQi6gbsZ95MMAexn68sEvntVaw9I7_UKoZlfQdjEqiEYm3qsshCMucpzh5z8w4kUhehd2Ow Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:31:57.616010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:31:57.617914 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}] Aug 17 07:31:57.617914 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:31:57.617914 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:31:57.617914 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:31:57.617914 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:31:57.617914 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:31:57.617914 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:31:57.617914 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: f8b0c96c80db4db4a477a1fa6c1fa4db Aug 17 07:31:57.617914 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:31:57.617914 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Aug 17 07:31:57.617914 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {"volumeAttachment": {"volumeId": "90f797b1-e932-4351-8386-5ab16a0711c0"}} Aug 17 07:31:57.617914 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Invalid volume: volume 90f797b1-e932-4351-8386-5ab16a0711c0 is already attached to instances: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'server_id': 'cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b', 'body': {'volumeAttachment': {'volumeId': '90f797b1-e932-4351-8386-5ab16a0711c0'}}} Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 90f797b1-e932-4351-8386-5ab16a0711c0 is already attached to instances: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:57.619428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 90f797b1-e932-4351-8386-5ab16a0711c0 is already attached to instances: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:31:57.620998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:31:57.622448 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:31:57.622448 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:31:57.622448 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:31:57.622448 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 90f797b1-e932-4351-8386-5ab16a0711c0 is already attached to instances: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b Aug 17 07:31:57.622448 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:31:57.622448 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b5221513-97b2-4419-92eb-496b8d57d3cd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Returning 400 to user: Invalid volume: volume 90f797b1-e932-4351-8386-5ab16a0711c0 is already attached to instances: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:31:57.622448 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b5221513-97b2-4419-92eb-496b8d57d3cd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "POST /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108446 Aug 17 07:31:57.623648 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 306/619] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 17 07:31:57 2022] POST /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 07:31:57.695376 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-0afa6740-11b0-4feb-a323-4f6fb22c12f5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:57.696032 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-0afa6740-11b0-4feb-a323-4f6fb22c12f5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:57.702294 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0afa6740-11b0-4feb-a323-4f6fb22c12f5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:57.702802 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0afa6740-11b0-4feb-a323-4f6fb22c12f5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:57.703977 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0afa6740-11b0-4feb-a323-4f6fb22c12f5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:57.704926 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0afa6740-11b0-4feb-a323-4f6fb22c12f5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:57.706380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0afa6740-11b0-4feb-a323-4f6fb22c12f5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:57.706817 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0afa6740-11b0-4feb-a323-4f6fb22c12f5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:57.903419 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.objects.instance [None req-0afa6740-11b0-4feb-a323-4f6fb22c12f5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lazy-loading 'services' on Instance uuid cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b {{(pid=120835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:31:58.033721 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-0afa6740-11b0-4feb-a323-4f6fb22c12f5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b/os-volume_attachments/90f797b1-e932-4351-8386-5ab16a0711c0" status: 202 len: 0 microversion: 2.1 time: 0.344686 Aug 17 07:31:58.038253 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 314/620] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 17 07:31:57 2022] DELETE /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b/os-volume_attachments/90f797b1-e932-4351-8386-5ab16a0711c0 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:31:58.044832 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9f85d4dd-0da4-41d5-ba57-d66929bfab4d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:58.047231 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9f85d4dd-0da4-41d5-ba57-d66929bfab4d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:58.057623 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9f85d4dd-0da4-41d5-ba57-d66929bfab4d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:58.058373 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9f85d4dd-0da4-41d5-ba57-d66929bfab4d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:58.059008 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9f85d4dd-0da4-41d5-ba57-d66929bfab4d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:58.059870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9f85d4dd-0da4-41d5-ba57-d66929bfab4d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:58.060478 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9f85d4dd-0da4-41d5-ba57-d66929bfab4d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:58.061230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9f85d4dd-0da4-41d5-ba57-d66929bfab4d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:58.100561 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9f85d4dd-0da4-41d5-ba57-d66929bfab4d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060785 Aug 17 07:31:58.101264 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 307/621] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:31:58 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:31:58.415267 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-eb0fc377-df39-4c7c-b014-5748807ef2d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:58.415849 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-eb0fc377-df39-4c7c-b014-5748807ef2d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:58.422662 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eb0fc377-df39-4c7c-b014-5748807ef2d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:58.423132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eb0fc377-df39-4c7c-b014-5748807ef2d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:58.423596 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eb0fc377-df39-4c7c-b014-5748807ef2d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:58.424476 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eb0fc377-df39-4c7c-b014-5748807ef2d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:58.425094 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eb0fc377-df39-4c7c-b014-5748807ef2d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:58.425519 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-eb0fc377-df39-4c7c-b014-5748807ef2d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:58.634953 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-eb0fc377-df39-4c7c-b014-5748807ef2d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:58.645413 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-eb0fc377-df39-4c7c-b014-5748807ef2d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1276 microversion: 2.1 time: 0.235605 Aug 17 07:31:58.671441 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 315/622] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:58 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1276 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:31:59.113715 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-fc469cd1-551e-4f98-8e85-3c4936247176 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:59.116024 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-fc469cd1-551e-4f98-8e85-3c4936247176 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:59.123003 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fc469cd1-551e-4f98-8e85-3c4936247176 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:59.123707 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fc469cd1-551e-4f98-8e85-3c4936247176 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:59.124139 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fc469cd1-551e-4f98-8e85-3c4936247176 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:59.124825 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fc469cd1-551e-4f98-8e85-3c4936247176 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:59.125264 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fc469cd1-551e-4f98-8e85-3c4936247176 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:59.125849 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fc469cd1-551e-4f98-8e85-3c4936247176 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:59.155196 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-fc469cd1-551e-4f98-8e85-3c4936247176 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046103 Aug 17 07:31:59.155758 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 308/623] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:31:59 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 07:31:59.217356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-41c6da68-acf6-44ee-99be-9ed8434f3590 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:59.217849 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-41c6da68-acf6-44ee-99be-9ed8434f3590 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:59.224337 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-41c6da68-acf6-44ee-99be-9ed8434f3590 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:59.224808 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-41c6da68-acf6-44ee-99be-9ed8434f3590 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:59.225237 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-41c6da68-acf6-44ee-99be-9ed8434f3590 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:59.225924 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-41c6da68-acf6-44ee-99be-9ed8434f3590 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:59.226442 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-41c6da68-acf6-44ee-99be-9ed8434f3590 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:59.226836 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-41c6da68-acf6-44ee-99be-9ed8434f3590 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:59.252166 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-41c6da68-acf6-44ee-99be-9ed8434f3590 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Going to try to terminate instance {{(pid=120835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:31:59.284026 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:59.330338 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-41c6da68-acf6-44ee-99be-9ed8434f3590 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b" status: 204 len: 0 microversion: 2.1 time: 0.116449 Aug 17 07:31:59.330923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 316/624] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:31:59 2022] DELETE /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:31:59.341202 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-3363ab09-171c-4348-8a5d-da90d348cf81 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:59.342812 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-3363ab09-171c-4348-8a5d-da90d348cf81 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:59.351367 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3363ab09-171c-4348-8a5d-da90d348cf81 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:59.352369 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3363ab09-171c-4348-8a5d-da90d348cf81 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:59.353188 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3363ab09-171c-4348-8a5d-da90d348cf81 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:59.354222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3363ab09-171c-4348-8a5d-da90d348cf81 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:59.354980 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3363ab09-171c-4348-8a5d-da90d348cf81 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:59.355488 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3363ab09-171c-4348-8a5d-da90d348cf81 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:59.522401 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-3363ab09-171c-4348-8a5d-da90d348cf81 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:59.531982 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-3363ab09-171c-4348-8a5d-da90d348cf81 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b" status: 200 len: 1682 microversion: 2.1 time: 0.196679 Aug 17 07:31:59.532638 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 309/625] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:59 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b => generated 1682 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:31:59.606100 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-b7c33f70-217d-469c-b711-e892378da58a req-38ba545e-d4ea-407a-8ac3-c93b61e27729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8429d063-003c-4918-85d8-7746d852a8be", "tag": "4929a810-8ffb-4736-afb2-d5142a3cb211"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:31:59.616341 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-b7c33f70-217d-469c-b711-e892378da58a req-38ba545e-d4ea-407a-8ac3-c93b61e27729 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:59.617288 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-b7c33f70-217d-469c-b711-e892378da58a req-38ba545e-d4ea-407a-8ac3-c93b61e27729 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:59.617719 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-b7c33f70-217d-469c-b711-e892378da58a req-38ba545e-d4ea-407a-8ac3-c93b61e27729 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:59.633126 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-b7c33f70-217d-469c-b711-e892378da58a req-38ba545e-d4ea-407a-8ac3-c93b61e27729 service nova] Creating event network-changed:4929a810-8ffb-4736-afb2-d5142a3cb211 for instance 8429d063-003c-4918-85d8-7746d852a8be on hv-cinder-85312 Aug 17 07:31:59.639519 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-b7c33f70-217d-469c-b711-e892378da58a req-38ba545e-d4ea-407a-8ac3-c93b61e27729 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037341 Aug 17 07:31:59.640436 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 317/626] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:31:59.666660 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-efc97f0f-2bcf-428a-845d-60911e632072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:31:59.667320 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-efc97f0f-2bcf-428a-845d-60911e632072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:31:59.673813 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-efc97f0f-2bcf-428a-845d-60911e632072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:59.674351 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-efc97f0f-2bcf-428a-845d-60911e632072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:59.674788 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-efc97f0f-2bcf-428a-845d-60911e632072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:59.675469 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-efc97f0f-2bcf-428a-845d-60911e632072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:31:59.675915 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-efc97f0f-2bcf-428a-845d-60911e632072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:31:59.676333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-efc97f0f-2bcf-428a-845d-60911e632072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:31:59.811039 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-efc97f0f-2bcf-428a-845d-60911e632072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:31:59.818673 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-efc97f0f-2bcf-428a-845d-60911e632072 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1264 microversion: 2.1 time: 0.155840 Aug 17 07:31:59.819242 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 310/627] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:31:59 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:32:00.554743 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-884efd3e-d555-4c40-b8d2-da12615a09eb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:00.555448 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-884efd3e-d555-4c40-b8d2-da12615a09eb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:00.561876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-884efd3e-d555-4c40-b8d2-da12615a09eb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:00.562397 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-884efd3e-d555-4c40-b8d2-da12615a09eb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:00.563430 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-884efd3e-d555-4c40-b8d2-da12615a09eb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:00.563522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-884efd3e-d555-4c40-b8d2-da12615a09eb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:00.564673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-884efd3e-d555-4c40-b8d2-da12615a09eb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:00.565286 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-884efd3e-d555-4c40-b8d2-da12615a09eb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:00.707312 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-884efd3e-d555-4c40-b8d2-da12615a09eb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:00.715078 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-884efd3e-d555-4c40-b8d2-da12615a09eb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b" status: 200 len: 1682 microversion: 2.1 time: 0.165733 Aug 17 07:32:00.715651 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 318/628] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:00 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:00.840170 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-2c1982a8-1283-4cd2-aabf-dec0d6ca3018 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:00.840774 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-2c1982a8-1283-4cd2-aabf-dec0d6ca3018 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:00.847916 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2c1982a8-1283-4cd2-aabf-dec0d6ca3018 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:00.849387 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2c1982a8-1283-4cd2-aabf-dec0d6ca3018 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:00.850208 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2c1982a8-1283-4cd2-aabf-dec0d6ca3018 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:00.850910 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2c1982a8-1283-4cd2-aabf-dec0d6ca3018 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:00.851359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2c1982a8-1283-4cd2-aabf-dec0d6ca3018 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:00.851779 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2c1982a8-1283-4cd2-aabf-dec0d6ca3018 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:00.996378 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-2c1982a8-1283-4cd2-aabf-dec0d6ca3018 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:01.004030 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-2c1982a8-1283-4cd2-aabf-dec0d6ca3018 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1264 microversion: 2.1 time: 0.167886 Aug 17 07:32:01.004904 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 311/629] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:00 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:32:01.736400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e6d1decd-4719-4f4e-9e1e-be7f91a62f4e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:01.737041 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e6d1decd-4719-4f4e-9e1e-be7f91a62f4e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:01.744017 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e6d1decd-4719-4f4e-9e1e-be7f91a62f4e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:01.744497 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e6d1decd-4719-4f4e-9e1e-be7f91a62f4e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:01.744932 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e6d1decd-4719-4f4e-9e1e-be7f91a62f4e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:01.745624 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e6d1decd-4719-4f4e-9e1e-be7f91a62f4e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:01.746104 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e6d1decd-4719-4f4e-9e1e-be7f91a62f4e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:01.746523 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e6d1decd-4719-4f4e-9e1e-be7f91a62f4e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:01.900571 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-e6d1decd-4719-4f4e-9e1e-be7f91a62f4e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:01.912711 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e6d1decd-4719-4f4e-9e1e-be7f91a62f4e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b" status: 200 len: 1682 microversion: 2.1 time: 0.180594 Aug 17 07:32:01.913297 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 319/630] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:01 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:02.024753 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-4bb79677-b6b3-4700-bb62-00309ad5e363 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:02.026013 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-4bb79677-b6b3-4700-bb62-00309ad5e363 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:02.033351 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4bb79677-b6b3-4700-bb62-00309ad5e363 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:02.034069 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4bb79677-b6b3-4700-bb62-00309ad5e363 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:02.034508 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4bb79677-b6b3-4700-bb62-00309ad5e363 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:02.035191 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4bb79677-b6b3-4700-bb62-00309ad5e363 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:02.035798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4bb79677-b6b3-4700-bb62-00309ad5e363 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:02.036215 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4bb79677-b6b3-4700-bb62-00309ad5e363 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:02.053776 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:02.212064 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-4bb79677-b6b3-4700-bb62-00309ad5e363 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:02.221311 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-4bb79677-b6b3-4700-bb62-00309ad5e363 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1264 microversion: 2.1 time: 0.200524 Aug 17 07:32:02.222215 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 312/631] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:02 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:02.714785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-2124fc48-1a97-49e6-8c3b-f4146f053bfb req-60d4677a-0fd3-4014-8eac-1babf31a0b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b", "name": "network-vif-deleted", "tag": "8a9d19f6-6245-4673-9203-4718282d7b7f"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:02.727823 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-2124fc48-1a97-49e6-8c3b-f4146f053bfb req-60d4677a-0fd3-4014-8eac-1babf31a0b4d service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:02.728607 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-2124fc48-1a97-49e6-8c3b-f4146f053bfb req-60d4677a-0fd3-4014-8eac-1babf31a0b4d service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:02.730999 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-2124fc48-1a97-49e6-8c3b-f4146f053bfb req-60d4677a-0fd3-4014-8eac-1babf31a0b4d service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:02.745417 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-2124fc48-1a97-49e6-8c3b-f4146f053bfb req-60d4677a-0fd3-4014-8eac-1babf31a0b4d service nova] Creating event network-vif-deleted:8a9d19f6-6245-4673-9203-4718282d7b7f for instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b on hv-cinder-85312 Aug 17 07:32:02.752861 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-2124fc48-1a97-49e6-8c3b-f4146f053bfb req-60d4677a-0fd3-4014-8eac-1babf31a0b4d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041565 Aug 17 07:32:02.753733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 320/632] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:03.110313 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b7aec3cd-cb21-4d9d-ac26-8b9c5f1653c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:03.111885 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-b7aec3cd-cb21-4d9d-ac26-8b9c5f1653c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:03.118195 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b7aec3cd-cb21-4d9d-ac26-8b9c5f1653c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:03.118756 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b7aec3cd-cb21-4d9d-ac26-8b9c5f1653c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:03.119286 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b7aec3cd-cb21-4d9d-ac26-8b9c5f1653c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:03.120048 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b7aec3cd-cb21-4d9d-ac26-8b9c5f1653c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:03.120577 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b7aec3cd-cb21-4d9d-ac26-8b9c5f1653c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:03.121081 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b7aec3cd-cb21-4d9d-ac26-8b9c5f1653c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:03.151202 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b7aec3cd-cb21-4d9d-ac26-8b9c5f1653c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:03.151669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b7aec3cd-cb21-4d9d-ac26-8b9c5f1653c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:03.152109 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b7aec3cd-cb21-4d9d-ac26-8b9c5f1653c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:03.152548 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.objects.instance [None req-b7aec3cd-cb21-4d9d-ac26-8b9c5f1653c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lazy-loading 'fault' on Instance uuid cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b {{(pid=120834) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:32:03.195725 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-b7aec3cd-cb21-4d9d-ac26-8b9c5f1653c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:03.202991 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b7aec3cd-cb21-4d9d-ac26-8b9c5f1653c9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b" status: 200 len: 1332 microversion: 2.1 time: 0.272867 Aug 17 07:32:03.203554 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 313/633] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:02 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b => generated 1332 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:03.243743 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9067315f-7f16-4ee4-a516-b2dfa07dc1f7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:03.244441 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-9067315f-7f16-4ee4-a516-b2dfa07dc1f7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:03.250440 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9067315f-7f16-4ee4-a516-b2dfa07dc1f7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:03.250914 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9067315f-7f16-4ee4-a516-b2dfa07dc1f7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:03.251346 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9067315f-7f16-4ee4-a516-b2dfa07dc1f7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:03.252028 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9067315f-7f16-4ee4-a516-b2dfa07dc1f7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:03.252474 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9067315f-7f16-4ee4-a516-b2dfa07dc1f7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:03.252894 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9067315f-7f16-4ee4-a516-b2dfa07dc1f7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:03.395447 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-9067315f-7f16-4ee4-a516-b2dfa07dc1f7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:03.405854 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-9067315f-7f16-4ee4-a516-b2dfa07dc1f7 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1264 microversion: 2.1 time: 0.166407 Aug 17 07:32:03.406675 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 321/634] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:03 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:03.610277 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ff46e8c6-e3f5-418d-93b1-b7970a5107ed tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:03.612727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ff46e8c6-e3f5-418d-93b1-b7970a5107ed tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:03.619870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ff46e8c6-e3f5-418d-93b1-b7970a5107ed tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:03.620440 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ff46e8c6-e3f5-418d-93b1-b7970a5107ed tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:03.621005 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ff46e8c6-e3f5-418d-93b1-b7970a5107ed tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:03.621728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ff46e8c6-e3f5-418d-93b1-b7970a5107ed tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:03.622283 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ff46e8c6-e3f5-418d-93b1-b7970a5107ed tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:03.622709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ff46e8c6-e3f5-418d-93b1-b7970a5107ed tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:03.657476 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ff46e8c6-e3f5-418d-93b1-b7970a5107ed tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047402 Aug 17 07:32:03.657476 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 314/635] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:32:03 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 07:32:03.724954 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-57a1ec21-b495-4515-8446-ea6f45d7e91d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:03.726170 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-57a1ec21-b495-4515-8446-ea6f45d7e91d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:03.734126 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57a1ec21-b495-4515-8446-ea6f45d7e91d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:03.734964 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57a1ec21-b495-4515-8446-ea6f45d7e91d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:03.735619 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57a1ec21-b495-4515-8446-ea6f45d7e91d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:03.736830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57a1ec21-b495-4515-8446-ea6f45d7e91d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:03.737648 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57a1ec21-b495-4515-8446-ea6f45d7e91d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:03.738490 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57a1ec21-b495-4515-8446-ea6f45d7e91d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:03.768771 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-57a1ec21-b495-4515-8446-ea6f45d7e91d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Going to try to terminate instance {{(pid=120835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:32:03.850454 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-57a1ec21-b495-4515-8446-ea6f45d7e91d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "DELETE /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 204 len: 0 microversion: 2.1 time: 0.135257 Aug 17 07:32:03.854105 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 322/636] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:32:03 2022] DELETE /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:32:03.859772 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ce921215-0a73-4b4d-93d7-ec5efc260289 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:03.860484 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ce921215-0a73-4b4d-93d7-ec5efc260289 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:03.867666 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ce921215-0a73-4b4d-93d7-ec5efc260289 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:03.868535 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ce921215-0a73-4b4d-93d7-ec5efc260289 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:03.869257 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ce921215-0a73-4b4d-93d7-ec5efc260289 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:03.870217 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ce921215-0a73-4b4d-93d7-ec5efc260289 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:03.870943 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ce921215-0a73-4b4d-93d7-ec5efc260289 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:03.871530 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ce921215-0a73-4b4d-93d7-ec5efc260289 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:03.999450 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ce921215-0a73-4b4d-93d7-ec5efc260289 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:04.007410 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ce921215-0a73-4b4d-93d7-ec5efc260289 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1674 microversion: 2.1 time: 0.151793 Aug 17 07:32:04.007977 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 315/637] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:03 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:32:04.223844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-f305cf3c-3449-4803-9b9c-cb223194ba52 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:04.224778 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-f305cf3c-3449-4803-9b9c-cb223194ba52 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:04.230803 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f305cf3c-3449-4803-9b9c-cb223194ba52 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:04.231278 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f305cf3c-3449-4803-9b9c-cb223194ba52 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:04.231703 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f305cf3c-3449-4803-9b9c-cb223194ba52 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:04.232386 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f305cf3c-3449-4803-9b9c-cb223194ba52 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:04.232831 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f305cf3c-3449-4803-9b9c-cb223194ba52 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:04.233249 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f305cf3c-3449-4803-9b9c-cb223194ba52 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:04.246945 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-f305cf3c-3449-4803-9b9c-cb223194ba52 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] HTTP exception thrown: Instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b could not be found. Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-f305cf3c-3449-4803-9b9c-cb223194ba52 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Request method failure captured: Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b HTTP/1.1 Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JhGMmtOHPQ5tXMBLT1ZWRDn92BoL8xS5HEV9kJ9w-VnlQw7GKIuWmct0Qgt_en_280xO3qINH5E37EeabHnDI9eZ1ASkmK0KnVQ204joQi6gbsZ95MMAexn68sEvntVaw9I7_UKoZlfQdjEqiEYm3qsshCMucpzh5z8w4kUhehd2Ow Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:32:04.248521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:32:04.250108 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}] Aug 17 07:32:04.250108 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:32:04.250108 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:32:04.250108 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:32:04.250108 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:32:04.250108 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:32:04.250108 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:32:04.250108 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: f8b0c96c80db4db4a477a1fa6c1fa4db Aug 17 07:32:04.250108 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:32:04.250108 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:32:04.250108 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b could not be found. Aug 17 07:32:04.250108 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': 'cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b'} Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b could not be found. Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:32:04.250901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:32:04.252811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:32:04.252811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:32:04.252811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:32:04.252811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:32:04.252811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:32:04.252811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:32:04.252811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:32:04.252811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b could not be found. Aug 17 07:32:04.252811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:32:04.252811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:32:04.252811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:32:04.252811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:32:04.252811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:32:04.252811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:32:04.252811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:32:04.252811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:32:04.252811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b could not be found. Aug 17 07:32:04.252811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:32:04.253863 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-f305cf3c-3449-4803-9b9c-cb223194ba52 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Returning 404 to user: Instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:32:04.253863 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-f305cf3c-3449-4803-9b9c-cb223194ba52 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b" status: 404 len: 111 microversion: 2.1 time: 0.030493 Aug 17 07:32:04.253863 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 323/638] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:04 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:32:04.259429 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b12cd736-1bce-4cde-9880-581b9c11d235 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '.version_select at 0x7f30ac1ae940>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:04.278830 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b12cd736-1bce-4cde-9880-581b9c11d235 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020590318" status: 202 len: 0 microversion: 2.1 time: 0.022971 Aug 17 07:32:04.279387 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 316/639] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Aug 17 07:32:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020590318 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:32:04.433457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a61f9eac-fe88-4b9d-9d7e-da4e7aee2bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:04.434278 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a61f9eac-fe88-4b9d-9d7e-da4e7aee2bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:04.441286 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a61f9eac-fe88-4b9d-9d7e-da4e7aee2bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:04.441819 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a61f9eac-fe88-4b9d-9d7e-da4e7aee2bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:04.442287 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a61f9eac-fe88-4b9d-9d7e-da4e7aee2bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:04.442983 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a61f9eac-fe88-4b9d-9d7e-da4e7aee2bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:04.443436 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a61f9eac-fe88-4b9d-9d7e-da4e7aee2bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:04.443885 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a61f9eac-fe88-4b9d-9d7e-da4e7aee2bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:04.684289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a61f9eac-fe88-4b9d-9d7e-da4e7aee2bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:04.691678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a61f9eac-fe88-4b9d-9d7e-da4e7aee2bce tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1264 microversion: 2.1 time: 0.262016 Aug 17 07:32:04.696507 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 324/640] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:04 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1264 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:04.965158 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-2e55af91-3e33-4add-b773-6f5d44ec8673 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Action: 'create', calling method: .version_select at 0x7f30ac2008b0>, body: {"keypair": {"name": "tempest-keypair-376869256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuXHW8eNzYhQvN5NWWx4N/ubslxHTQX73cRrPQoo3Jv3FuO8UwtasnOe2nt8avpYGF4dJUEFGLcEAggzjPsCQb8SR6Wisa8kpj+gbntvQRtpaeb3Ui0V3JMdntCQV15sA=="}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:04.980912 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-2e55af91-3e33-4add-b773-6f5d44ec8673 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Getting quotas for project 99d9a3fa9369495ab6d8da88f3d9dbd5. Resources: {'key_pairs'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:32:04.984893 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-2e55af91-3e33-4add-b773-6f5d44ec8673 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Getting quotas for user f8b0c96c80db4db4a477a1fa6c1fa4db and project 99d9a3fa9369495ab6d8da88f3d9dbd5. Resources: {'key_pairs'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:32:05.007636 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-2e55af91-3e33-4add-b773-6f5d44ec8673 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046392 Aug 17 07:32:05.008229 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 317/641] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 17 07:32:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:05.028757 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-675997b7-b2dc-45e3-beef-8ec7bac5f2a9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:05.029371 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-675997b7-b2dc-45e3-beef-8ec7bac5f2a9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:05.036050 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-675997b7-b2dc-45e3-beef-8ec7bac5f2a9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:05.036529 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-675997b7-b2dc-45e3-beef-8ec7bac5f2a9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:05.036967 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-675997b7-b2dc-45e3-beef-8ec7bac5f2a9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:05.037659 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-675997b7-b2dc-45e3-beef-8ec7bac5f2a9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:05.038153 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-675997b7-b2dc-45e3-beef-8ec7bac5f2a9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:05.038582 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-675997b7-b2dc-45e3-beef-8ec7bac5f2a9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:05.234704 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-675997b7-b2dc-45e3-beef-8ec7bac5f2a9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:05.243172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-675997b7-b2dc-45e3-beef-8ec7bac5f2a9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1674 microversion: 2.1 time: 0.218415 Aug 17 07:32:05.243966 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 325/642] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:05 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1674 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:05.712396 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-94c1caf9-99b2-418b-bcdc-09809c1c78f1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:05.713577 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-94c1caf9-99b2-418b-bcdc-09809c1c78f1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:05.720795 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94c1caf9-99b2-418b-bcdc-09809c1c78f1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:05.721059 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94c1caf9-99b2-418b-bcdc-09809c1c78f1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:05.721496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94c1caf9-99b2-418b-bcdc-09809c1c78f1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:05.722222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94c1caf9-99b2-418b-bcdc-09809c1c78f1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:05.722682 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94c1caf9-99b2-418b-bcdc-09809c1c78f1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:05.723109 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-94c1caf9-99b2-418b-bcdc-09809c1c78f1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:05.857655 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-94c1caf9-99b2-418b-bcdc-09809c1c78f1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:05.865181 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-94c1caf9-99b2-418b-bcdc-09809c1c78f1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1264 microversion: 2.1 time: 0.156638 Aug 17 07:32:05.865759 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 318/643] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:05 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:06.264720 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-6bd3fb05-e610-4231-abb1-746e8fb68768 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:06.265359 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-6bd3fb05-e610-4231-abb1-746e8fb68768 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:06.268046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=2 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:06.268713 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=6 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:06.274952 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6bd3fb05-e610-4231-abb1-746e8fb68768 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:06.275434 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6bd3fb05-e610-4231-abb1-746e8fb68768 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:06.275874 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6bd3fb05-e610-4231-abb1-746e8fb68768 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:06.276573 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6bd3fb05-e610-4231-abb1-746e8fb68768 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:06.277025 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6bd3fb05-e610-4231-abb1-746e8fb68768 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:06.277451 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6bd3fb05-e610-4231-abb1-746e8fb68768 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:06.298177 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9bec7bcf-e0cb-451d-bec5-fd892cbdc05c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1350235713", "imageRef": "37843ca7-b19a-44f1-acf3-e9432324d4b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b93cc108-9c01-472b-9ec8-1ea1c98d8816"}], "security_groups": [{"name": "tempest-securitygroup--1609618745"}], "key_name": "tempest-keypair-376869256", "user_data": "}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:06.437819 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.network.neutron [None req-9bec7bcf-e0cb-451d-bec5-fd892cbdc05c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] validate_networks() for [('b93cc108-9c01-472b-9ec8-1ea1c98d8816', None, None, None, None, None)] {{(pid=120834) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:32:06.442653 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-6bd3fb05-e610-4231-abb1-746e8fb68768 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:06.450681 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-6bd3fb05-e610-4231-abb1-746e8fb68768 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1674 microversion: 2.1 time: 0.189816 Aug 17 07:32:06.462203 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 326/644] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:06 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1674 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:06.888235 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-089f4794-e32f-4620-b60b-bb5a52249f73 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:06.888840 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-089f4794-e32f-4620-b60b-bb5a52249f73 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:06.896252 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-089f4794-e32f-4620-b60b-bb5a52249f73 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:06.897063 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-089f4794-e32f-4620-b60b-bb5a52249f73 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:06.897159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-089f4794-e32f-4620-b60b-bb5a52249f73 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:06.897864 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-089f4794-e32f-4620-b60b-bb5a52249f73 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:06.898342 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-089f4794-e32f-4620-b60b-bb5a52249f73 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:06.898660 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-9bec7bcf-e0cb-451d-bec5-fd892cbdc05c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Flavor limits 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:32:06.899101 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-089f4794-e32f-4620-b60b-bb5a52249f73 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:06.899192 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-9bec7bcf-e0cb-451d-bec5-fd892cbdc05c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Image limits 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:32:06.899537 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-9bec7bcf-e0cb-451d-bec5-fd892cbdc05c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Flavor pref 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:32:06.899962 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-9bec7bcf-e0cb-451d-bec5-fd892cbdc05c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Image pref 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:32:06.900365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-9bec7bcf-e0cb-451d-bec5-fd892cbdc05c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:32:06.909832 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9bec7bcf-e0cb-451d-bec5-fd892cbdc05c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:06.910424 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9bec7bcf-e0cb-451d-bec5-fd892cbdc05c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:06.911043 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9bec7bcf-e0cb-451d-bec5-fd892cbdc05c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:06.911758 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9bec7bcf-e0cb-451d-bec5-fd892cbdc05c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:06.912202 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9bec7bcf-e0cb-451d-bec5-fd892cbdc05c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:06.912620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9bec7bcf-e0cb-451d-bec5-fd892cbdc05c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:06.930204 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-9bec7bcf-e0cb-451d-bec5-fd892cbdc05c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Getting quotas for project 99d9a3fa9369495ab6d8da88f3d9dbd5. Resources: {'ram', 'cores', 'instances'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:32:06.934187 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-9bec7bcf-e0cb-451d-bec5-fd892cbdc05c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Getting quotas for user f8b0c96c80db4db4a477a1fa6c1fa4db and project 99d9a3fa9369495ab6d8da88f3d9dbd5. Resources: {'ram', 'cores', 'instances'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:32:06.946419 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9bec7bcf-e0cb-451d-bec5-fd892cbdc05c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Going to run 1 instances... {{(pid=120834) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:32:06.949585 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9bec7bcf-e0cb-451d-bec5-fd892cbdc05c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37843ca7-b19a-44f1-acf3-e9432324d4b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120834) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:32:07.001377 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9bec7bcf-e0cb-451d-bec5-fd892cbdc05c tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.707336 Aug 17 07:32:07.002158 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 319/645] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:32:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 07:32:07.014171 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ed4c81db-c428-47c0-88bf-49fc0d112bd1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:07.015065 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ed4c81db-c428-47c0-88bf-49fc0d112bd1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:07.093181 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ed4c81db-c428-47c0-88bf-49fc0d112bd1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:07.098516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-089f4794-e32f-4620-b60b-bb5a52249f73 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:07.104949 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ed4c81db-c428-47c0-88bf-49fc0d112bd1 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 200 len: 1241 microversion: 2.1 time: 0.095132 Aug 17 07:32:07.107863 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-089f4794-e32f-4620-b60b-bb5a52249f73 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1264 microversion: 2.1 time: 0.223970 Aug 17 07:32:07.110220 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 327/647] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:06 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:32:07.115465 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 320/647] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:07 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:07.474554 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-79381523-9245-4cdd-b90d-509d418a22bd tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:07.475885 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-79381523-9245-4cdd-b90d-509d418a22bd tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:07.482633 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-79381523-9245-4cdd-b90d-509d418a22bd tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:07.483115 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-79381523-9245-4cdd-b90d-509d418a22bd tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:07.483545 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-79381523-9245-4cdd-b90d-509d418a22bd tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:07.484413 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-79381523-9245-4cdd-b90d-509d418a22bd tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:07.484870 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-79381523-9245-4cdd-b90d-509d418a22bd tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:07.485306 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-79381523-9245-4cdd-b90d-509d418a22bd tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:07.624396 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-79381523-9245-4cdd-b90d-509d418a22bd tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:07.633187 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-79381523-9245-4cdd-b90d-509d418a22bd tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1674 microversion: 2.1 time: 0.164639 Aug 17 07:32:07.633769 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 328/648] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:07 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:07.921606 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-e40b673b-f391-42e6-81a7-22376cac83a9 req-05c33447-7ac5-4501-b42f-f2b14173c585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d1495a-563e-4c4f-ba8c-1fa046813a22", "name": "network-vif-deleted", "tag": "4baae37f-d765-4b53-bd78-8bf3e3c5f440"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:07.931162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-e40b673b-f391-42e6-81a7-22376cac83a9 req-05c33447-7ac5-4501-b42f-f2b14173c585 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:07.931634 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-e40b673b-f391-42e6-81a7-22376cac83a9 req-05c33447-7ac5-4501-b42f-f2b14173c585 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:07.932058 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-e40b673b-f391-42e6-81a7-22376cac83a9 req-05c33447-7ac5-4501-b42f-f2b14173c585 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:07.942783 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-e40b673b-f391-42e6-81a7-22376cac83a9 req-05c33447-7ac5-4501-b42f-f2b14173c585 service nova] Creating event network-vif-deleted:4baae37f-d765-4b53-bd78-8bf3e3c5f440 for instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 on hv-cinder-85312 Aug 17 07:32:07.947817 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-e40b673b-f391-42e6-81a7-22376cac83a9 req-05c33447-7ac5-4501-b42f-f2b14173c585 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029866 Aug 17 07:32:07.948414 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 321/649] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:08.126776 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a4d6743b-8d40-4f19-baf7-cc1f1a3eab63 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:08.127309 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a4d6743b-8d40-4f19-baf7-cc1f1a3eab63 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:08.132056 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f5b756c6-e97a-455f-b686-a7d23949b450 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:08.132754 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f5b756c6-e97a-455f-b686-a7d23949b450 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:08.134673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a4d6743b-8d40-4f19-baf7-cc1f1a3eab63 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:08.135348 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a4d6743b-8d40-4f19-baf7-cc1f1a3eab63 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:08.135950 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a4d6743b-8d40-4f19-baf7-cc1f1a3eab63 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:08.136817 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a4d6743b-8d40-4f19-baf7-cc1f1a3eab63 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:08.137428 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a4d6743b-8d40-4f19-baf7-cc1f1a3eab63 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:08.138039 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a4d6743b-8d40-4f19-baf7-cc1f1a3eab63 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:08.138836 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f5b756c6-e97a-455f-b686-a7d23949b450 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:08.139312 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f5b756c6-e97a-455f-b686-a7d23949b450 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:08.139744 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f5b756c6-e97a-455f-b686-a7d23949b450 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:08.140538 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f5b756c6-e97a-455f-b686-a7d23949b450 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:08.141250 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f5b756c6-e97a-455f-b686-a7d23949b450 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:08.141675 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f5b756c6-e97a-455f-b686-a7d23949b450 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:08.209645 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a4d6743b-8d40-4f19-baf7-cc1f1a3eab63 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:08.217075 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a4d6743b-8d40-4f19-baf7-cc1f1a3eab63 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 200 len: 1245 microversion: 2.1 time: 0.094287 Aug 17 07:32:08.217792 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 329/650] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:08 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:08.302021 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f5b756c6-e97a-455f-b686-a7d23949b450 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:08.309765 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f5b756c6-e97a-455f-b686-a7d23949b450 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1264 microversion: 2.1 time: 0.182038 Aug 17 07:32:08.310568 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 322/651] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:08 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:08.654033 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-cfee542e-d97b-4c14-b741-d981e0521b83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:08.654641 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-cfee542e-d97b-4c14-b741-d981e0521b83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:08.661204 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-cfee542e-d97b-4c14-b741-d981e0521b83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:08.661593 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-cfee542e-d97b-4c14-b741-d981e0521b83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:08.662059 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-cfee542e-d97b-4c14-b741-d981e0521b83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:08.662742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-cfee542e-d97b-4c14-b741-d981e0521b83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:08.663193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-cfee542e-d97b-4c14-b741-d981e0521b83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:08.663661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-cfee542e-d97b-4c14-b741-d981e0521b83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:08.730456 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-cfee542e-d97b-4c14-b741-d981e0521b83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:08.738576 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-cfee542e-d97b-4c14-b741-d981e0521b83 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1606 microversion: 2.1 time: 0.088349 Aug 17 07:32:08.739150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 330/652] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:08 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1606 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:09.237871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-d733a01c-b40d-48e3-9297-9e82ce98bcc7 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:09.238536 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-d733a01c-b40d-48e3-9297-9e82ce98bcc7 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:09.245183 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d733a01c-b40d-48e3-9297-9e82ce98bcc7 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:09.245660 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d733a01c-b40d-48e3-9297-9e82ce98bcc7 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:09.246127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d733a01c-b40d-48e3-9297-9e82ce98bcc7 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:09.246821 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d733a01c-b40d-48e3-9297-9e82ce98bcc7 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:09.247273 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d733a01c-b40d-48e3-9297-9e82ce98bcc7 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:09.247718 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d733a01c-b40d-48e3-9297-9e82ce98bcc7 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:09.306669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-d733a01c-b40d-48e3-9297-9e82ce98bcc7 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:09.313989 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-d733a01c-b40d-48e3-9297-9e82ce98bcc7 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 200 len: 1245 microversion: 2.1 time: 0.080679 Aug 17 07:32:09.314555 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 323/653] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:09 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:09.331446 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-74a3b4f3-9370-4410-8317-764eaa451f02 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:09.332100 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-74a3b4f3-9370-4410-8317-764eaa451f02 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:09.338076 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-74a3b4f3-9370-4410-8317-764eaa451f02 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:09.338556 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-74a3b4f3-9370-4410-8317-764eaa451f02 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:09.338990 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-74a3b4f3-9370-4410-8317-764eaa451f02 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:09.339676 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-74a3b4f3-9370-4410-8317-764eaa451f02 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:09.340129 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-74a3b4f3-9370-4410-8317-764eaa451f02 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:09.340553 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-74a3b4f3-9370-4410-8317-764eaa451f02 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:09.472691 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-74a3b4f3-9370-4410-8317-764eaa451f02 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:09.480166 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-74a3b4f3-9370-4410-8317-764eaa451f02 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1264 microversion: 2.1 time: 0.152997 Aug 17 07:32:09.480728 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 331/654] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:09 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:09.760220 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-21433f28-b47b-4ee5-ba47-61fc03fee1d5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:09.760826 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-21433f28-b47b-4ee5-ba47-61fc03fee1d5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:09.767381 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-21433f28-b47b-4ee5-ba47-61fc03fee1d5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:09.767866 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-21433f28-b47b-4ee5-ba47-61fc03fee1d5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:09.768300 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-21433f28-b47b-4ee5-ba47-61fc03fee1d5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:09.768982 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-21433f28-b47b-4ee5-ba47-61fc03fee1d5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:09.769433 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-21433f28-b47b-4ee5-ba47-61fc03fee1d5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:09.769858 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-21433f28-b47b-4ee5-ba47-61fc03fee1d5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:09.828595 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-21433f28-b47b-4ee5-ba47-61fc03fee1d5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:09.836669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-21433f28-b47b-4ee5-ba47-61fc03fee1d5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1606 microversion: 2.1 time: 0.080362 Aug 17 07:32:09.837225 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 324/655] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:09 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1606 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:10.335643 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-08b49b7f-26ea-4edd-9e82-71e770650b59 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:10.336254 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-08b49b7f-26ea-4edd-9e82-71e770650b59 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:10.343584 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-08b49b7f-26ea-4edd-9e82-71e770650b59 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:10.344227 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-08b49b7f-26ea-4edd-9e82-71e770650b59 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:10.344742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-08b49b7f-26ea-4edd-9e82-71e770650b59 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:10.345508 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-08b49b7f-26ea-4edd-9e82-71e770650b59 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:10.347112 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-08b49b7f-26ea-4edd-9e82-71e770650b59 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:10.347425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-08b49b7f-26ea-4edd-9e82-71e770650b59 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:10.420115 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-08b49b7f-26ea-4edd-9e82-71e770650b59 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:10.428105 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-08b49b7f-26ea-4edd-9e82-71e770650b59 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 200 len: 1237 microversion: 2.1 time: 0.097476 Aug 17 07:32:10.428701 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 332/656] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:10 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 1237 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:10.500889 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-91fea91d-3b0b-4d20-b412-3b0bd19982ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:10.501439 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-91fea91d-3b0b-4d20-b412-3b0bd19982ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:10.507817 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-91fea91d-3b0b-4d20-b412-3b0bd19982ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:10.508284 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-91fea91d-3b0b-4d20-b412-3b0bd19982ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:10.508712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-91fea91d-3b0b-4d20-b412-3b0bd19982ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:10.509390 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-91fea91d-3b0b-4d20-b412-3b0bd19982ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:10.509835 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-91fea91d-3b0b-4d20-b412-3b0bd19982ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:10.510287 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-91fea91d-3b0b-4d20-b412-3b0bd19982ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:10.646868 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-91fea91d-3b0b-4d20-b412-3b0bd19982ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:10.654308 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-91fea91d-3b0b-4d20-b412-3b0bd19982ed tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1264 microversion: 2.1 time: 0.157311 Aug 17 07:32:10.654868 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 325/657] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:10 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:10.857364 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-8c24184e-1d6b-4331-be8d-7b32effd3312 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:10.858335 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-8c24184e-1d6b-4331-be8d-7b32effd3312 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:10.864427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8c24184e-1d6b-4331-be8d-7b32effd3312 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:10.865031 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8c24184e-1d6b-4331-be8d-7b32effd3312 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:10.865535 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8c24184e-1d6b-4331-be8d-7b32effd3312 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:10.866336 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8c24184e-1d6b-4331-be8d-7b32effd3312 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:10.866863 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8c24184e-1d6b-4331-be8d-7b32effd3312 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:10.867620 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8c24184e-1d6b-4331-be8d-7b32effd3312 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:10.871927 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:10.903467 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8c24184e-1d6b-4331-be8d-7b32effd3312 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:10.903955 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8c24184e-1d6b-4331-be8d-7b32effd3312 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:10.904395 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8c24184e-1d6b-4331-be8d-7b32effd3312 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:10.904837 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.objects.instance [None req-8c24184e-1d6b-4331-be8d-7b32effd3312 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lazy-loading 'fault' on Instance uuid 84d1495a-563e-4c4f-ba8c-1fa046813a22 {{(pid=120835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:32:10.947078 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-8c24184e-1d6b-4331-be8d-7b32effd3312 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:10.955319 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-8c24184e-1d6b-4331-be8d-7b32effd3312 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 200 len: 1328 microversion: 2.1 time: 0.101846 Aug 17 07:32:10.955942 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 333/658] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:10 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 1328 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:11.105341 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7bffcc29-7f64-4187-acfa-5e4305284326 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:11.105841 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-7bffcc29-7f64-4187-acfa-5e4305284326 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:11.111719 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7bffcc29-7f64-4187-acfa-5e4305284326 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:11.112205 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7bffcc29-7f64-4187-acfa-5e4305284326 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:11.112641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7bffcc29-7f64-4187-acfa-5e4305284326 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:11.113329 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7bffcc29-7f64-4187-acfa-5e4305284326 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:11.113782 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7bffcc29-7f64-4187-acfa-5e4305284326 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:11.114238 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7bffcc29-7f64-4187-acfa-5e4305284326 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:11.136991 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-7bffcc29-7f64-4187-acfa-5e4305284326 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934/ips" status: 200 len: 151 microversion: 2.20 time: 0.134607 Aug 17 07:32:11.137552 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 326/659] 10.222.0.45 () {60 vars in 1289 bytes} [Wed Aug 17 07:32:11 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934/ips => generated 151 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 07:32:11.451547 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-12271def-8284-47af-890c-7c994fa65d72 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:11.452996 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-12271def-8284-47af-890c-7c994fa65d72 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:11.461053 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-12271def-8284-47af-890c-7c994fa65d72 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:11.461873 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-12271def-8284-47af-890c-7c994fa65d72 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:11.463439 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-12271def-8284-47af-890c-7c994fa65d72 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:11.464543 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-12271def-8284-47af-890c-7c994fa65d72 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:11.465487 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-12271def-8284-47af-890c-7c994fa65d72 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:11.466161 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-12271def-8284-47af-890c-7c994fa65d72 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:11.543394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-12271def-8284-47af-890c-7c994fa65d72 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:11.554681 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-12271def-8284-47af-890c-7c994fa65d72 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 200 len: 1301 microversion: 2.1 time: 0.107502 Aug 17 07:32:11.556353 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 334/660] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:11 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 1301 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:11.676600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-5e6c651a-2999-4007-9cd0-34005eeaf8c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:11.677344 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-5e6c651a-2999-4007-9cd0-34005eeaf8c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:11.684372 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5e6c651a-2999-4007-9cd0-34005eeaf8c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:11.685059 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5e6c651a-2999-4007-9cd0-34005eeaf8c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:11.685496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5e6c651a-2999-4007-9cd0-34005eeaf8c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:11.686480 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5e6c651a-2999-4007-9cd0-34005eeaf8c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:11.687146 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5e6c651a-2999-4007-9cd0-34005eeaf8c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:11.687770 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5e6c651a-2999-4007-9cd0-34005eeaf8c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:11.841416 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-5e6c651a-2999-4007-9cd0-34005eeaf8c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:11.853285 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-5e6c651a-2999-4007-9cd0-34005eeaf8c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1264 microversion: 2.1 time: 0.181473 Aug 17 07:32:11.854323 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 327/661] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:11 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:11.976945 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-489b46aa-a23f-4d0c-a91e-b38352a88ac9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:11.977551 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-489b46aa-a23f-4d0c-a91e-b38352a88ac9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:11.983551 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-489b46aa-a23f-4d0c-a91e-b38352a88ac9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:11.984037 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-489b46aa-a23f-4d0c-a91e-b38352a88ac9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:11.984495 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-489b46aa-a23f-4d0c-a91e-b38352a88ac9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:11.985164 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-489b46aa-a23f-4d0c-a91e-b38352a88ac9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:11.986188 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-489b46aa-a23f-4d0c-a91e-b38352a88ac9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:11.986618 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-489b46aa-a23f-4d0c-a91e-b38352a88ac9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:11.999918 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-489b46aa-a23f-4d0c-a91e-b38352a88ac9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] HTTP exception thrown: Instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 could not be found. Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-489b46aa-a23f-4d0c-a91e-b38352a88ac9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Request method failure captured: Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 HTTP/1.1 Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JhG_obk1inmT-LpGftVC8T_Y8-pPVjLVEglzNX3UWJnFKSaygoEUadJWBB4wc6CY_m1NhNRYkDoN3i_zhO67OseVSYrxfs2pq5bj9nfMx8H5Hjc4Mn1eAzXoC5ol4Ys42C-4fT14ZE_lGe5ULsQ0w7YQ1WfiQ-SVzhswGz_4MT3Z6s Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 3c491181ae054706be3bdc94c61501f9 Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-AttachVolumeTestJSON-1998608911 Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:32:12.001505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:32:12.003159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3c491181ae054706be3bdc94c61501f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3c491181ae054706be3bdc94c61501f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c491181ae054706be3bdc94c61501f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c491181ae054706be3bdc94c61501f9"}]}] Aug 17 07:32:12.003159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-AttachVolumeTestJSON-1998608911 Aug 17 07:32:12.003159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 3c491181ae054706be3bdc94c61501f9 Aug 17 07:32:12.003159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1998608911 Aug 17 07:32:12.003159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-AttachVolumeTestJSON-1998608911-project Aug 17 07:32:12.003159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:32:12.003159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:32:12.003159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: c11d183b3c0c4b2b83f3b52b881a72cf Aug 17 07:32:12.003159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-AttachVolumeTestJSON-1998608911-project Aug 17 07:32:12.003159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:32:12.003159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 could not be found. Aug 17 07:32:12.003159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': '84d1495a-563e-4c4f-ba8c-1fa046813a22'} Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 could not be found. Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:32:12.004046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:32:12.005516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:32:12.005516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:32:12.005516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:32:12.005516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:32:12.005516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:32:12.005516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:32:12.005516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:32:12.005516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 could not be found. Aug 17 07:32:12.005516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:32:12.005516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:32:12.005516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:32:12.005516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:32:12.005516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:32:12.005516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:32:12.005516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:32:12.005516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:32:12.005516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 could not be found. Aug 17 07:32:12.005516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:32:12.007111 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-489b46aa-a23f-4d0c-a91e-b38352a88ac9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Returning 404 to user: Instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:32:12.007111 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-489b46aa-a23f-4d0c-a91e-b38352a88ac9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 404 len: 111 microversion: 2.1 time: 0.029800 Aug 17 07:32:12.007111 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 335/662] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:11 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:32:12.012316 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-996f7b7d-1e3b-4008-9bae-3e57d42fecd0 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '.version_select at 0x7f30ac211160>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:12.033496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-996f7b7d-1e3b-4008-9bae-3e57d42fecd0 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2002418318" status: 202 len: 0 microversion: 2.1 time: 0.024873 Aug 17 07:32:12.034418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 328/663] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Aug 17 07:32:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2002418318 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:32:12.576599 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-238e8e2c-63f2-410a-bd20-def8ae6aecaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:12.577210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-238e8e2c-63f2-410a-bd20-def8ae6aecaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:12.584257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-238e8e2c-63f2-410a-bd20-def8ae6aecaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:12.584955 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-238e8e2c-63f2-410a-bd20-def8ae6aecaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:12.585539 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-238e8e2c-63f2-410a-bd20-def8ae6aecaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:12.586255 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-238e8e2c-63f2-410a-bd20-def8ae6aecaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:12.586704 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-238e8e2c-63f2-410a-bd20-def8ae6aecaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:12.587902 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-238e8e2c-63f2-410a-bd20-def8ae6aecaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:12.836512 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-238e8e2c-63f2-410a-bd20-def8ae6aecaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:12.881028 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-4a47fa2c-3dcc-49ea-9d63-038377760fb1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Action: 'create', calling method: .version_select at 0x7f30ac3a2ee0>, body: {"keypair": {"name": "tempest-keypair-194160104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEqJNM8tK5k835GYLdhYXbLdCYUujjf9TvlFf6mlrVwC9Q+wNHNtimG4wNJb65Q5pW2C4SuqtA1IKftPmuJVGiOQP5JRJTp2st+t8sm5exLLMYy85KWSFrXPGVUON95Rg=="}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:12.898557 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-238e8e2c-63f2-410a-bd20-def8ae6aecaa tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 200 len: 1367 microversion: 2.1 time: 0.325630 Aug 17 07:32:12.899471 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 336/664] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:12 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:12.905920 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2be8e01f-4675-409d-a8fd-c4390791726a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:12.906566 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-2be8e01f-4675-409d-a8fd-c4390791726a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:12.923570 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-4a47fa2c-3dcc-49ea-9d63-038377760fb1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Getting quotas for project 3c491181ae054706be3bdc94c61501f9. Resources: {'key_pairs'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:32:12.926477 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2be8e01f-4675-409d-a8fd-c4390791726a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:12.926950 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2be8e01f-4675-409d-a8fd-c4390791726a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:12.932594 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2be8e01f-4675-409d-a8fd-c4390791726a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:12.933659 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2be8e01f-4675-409d-a8fd-c4390791726a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:12.934461 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2be8e01f-4675-409d-a8fd-c4390791726a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:12.936679 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-4a47fa2c-3dcc-49ea-9d63-038377760fb1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Getting quotas for user c11d183b3c0c4b2b83f3b52b881a72cf and project 3c491181ae054706be3bdc94c61501f9. Resources: {'key_pairs'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:32:12.937387 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2be8e01f-4675-409d-a8fd-c4390791726a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:12.985114 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-4a47fa2c-3dcc-49ea-9d63-038377760fb1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116161 Aug 17 07:32:12.986233 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 329/665] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 17 07:32:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:13.083717 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-df140988-5931-4dad-b6bb-74ab7be8e904 req-e536cee2-8a45-4603-8458-57839d9ce31f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7dc7f93-7079-4b42-a379-f28a28546aaa", "tag": "40775ac5-a507-4994-a119-9ac097c452e5"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:13.092722 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=5 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:13.098885 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-df140988-5931-4dad-b6bb-74ab7be8e904 req-e536cee2-8a45-4603-8458-57839d9ce31f service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:13.099648 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-df140988-5931-4dad-b6bb-74ab7be8e904 req-e536cee2-8a45-4603-8458-57839d9ce31f service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:13.100581 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-df140988-5931-4dad-b6bb-74ab7be8e904 req-e536cee2-8a45-4603-8458-57839d9ce31f service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:13.116012 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-df140988-5931-4dad-b6bb-74ab7be8e904 req-e536cee2-8a45-4603-8458-57839d9ce31f service nova] Creating event network-changed:40775ac5-a507-4994-a119-9ac097c452e5 for instance f7dc7f93-7079-4b42-a379-f28a28546aaa on hv-cinder-85312 Aug 17 07:32:13.124747 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-df140988-5931-4dad-b6bb-74ab7be8e904 req-e536cee2-8a45-4603-8458-57839d9ce31f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045491 Aug 17 07:32:13.126849 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 330/666] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:32:13.139528 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2be8e01f-4675-409d-a8fd-c4390791726a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:13.148072 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-2be8e01f-4675-409d-a8fd-c4390791726a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1264 microversion: 2.1 time: 0.246277 Aug 17 07:32:13.148647 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 337/667] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:12 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1264 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:13.154757 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1b26a9fc-3c07-421d-9890-28a73c3e0a1f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:13.155620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-1b26a9fc-3c07-421d-9890-28a73c3e0a1f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:13.163505 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1b26a9fc-3c07-421d-9890-28a73c3e0a1f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:13.163993 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1b26a9fc-3c07-421d-9890-28a73c3e0a1f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:13.164429 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1b26a9fc-3c07-421d-9890-28a73c3e0a1f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:13.165361 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1b26a9fc-3c07-421d-9890-28a73c3e0a1f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:13.165733 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1b26a9fc-3c07-421d-9890-28a73c3e0a1f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:13.166965 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1b26a9fc-3c07-421d-9890-28a73c3e0a1f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:13.193948 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.objects.instance [None req-1b26a9fc-3c07-421d-9890-28a73c3e0a1f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lazy-loading 'flavor' on Instance uuid c084749b-e2a5-48ae-a864-1ef8c56b5934 {{(pid=120834) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:32:13.381591 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-1b26a9fc-3c07-421d-9890-28a73c3e0a1f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "POST /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934/action" status: 202 len: 0 microversion: 2.20 time: 0.248155 Aug 17 07:32:13.382513 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 331/668] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 17 07:32:13 2022] POST /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:32:13.391576 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-fab801b7-2e96-4cdd-95dc-b464b9f3f92a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:13.392303 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-fab801b7-2e96-4cdd-95dc-b464b9f3f92a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:13.401316 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fab801b7-2e96-4cdd-95dc-b464b9f3f92a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:13.401885 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fab801b7-2e96-4cdd-95dc-b464b9f3f92a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:13.402424 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fab801b7-2e96-4cdd-95dc-b464b9f3f92a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:13.403195 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fab801b7-2e96-4cdd-95dc-b464b9f3f92a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:13.403877 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fab801b7-2e96-4cdd-95dc-b464b9f3f92a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:13.405073 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fab801b7-2e96-4cdd-95dc-b464b9f3f92a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:13.550084 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-fab801b7-2e96-4cdd-95dc-b464b9f3f92a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:13.558505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-fab801b7-2e96-4cdd-95dc-b464b9f3f92a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:13.560014 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-fab801b7-2e96-4cdd-95dc-b464b9f3f92a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:13.561385 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-fab801b7-2e96-4cdd-95dc-b464b9f3f92a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1722 microversion: 2.20 time: 0.174425 Aug 17 07:32:13.561947 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 338/669] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:13 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:32:13.924218 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0db72b99-a085-492a-814b-2e3d734ad34d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:13.924863 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0db72b99-a085-492a-814b-2e3d734ad34d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:13.931690 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0db72b99-a085-492a-814b-2e3d734ad34d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:13.932213 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0db72b99-a085-492a-814b-2e3d734ad34d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:13.932655 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0db72b99-a085-492a-814b-2e3d734ad34d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:13.933401 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0db72b99-a085-492a-814b-2e3d734ad34d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:13.933857 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0db72b99-a085-492a-814b-2e3d734ad34d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:13.934318 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0db72b99-a085-492a-814b-2e3d734ad34d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:14.071358 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0db72b99-a085-492a-814b-2e3d734ad34d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:14.078894 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0db72b99-a085-492a-814b-2e3d734ad34d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 200 len: 1367 microversion: 2.1 time: 0.159534 Aug 17 07:32:14.079475 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 332/670] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:13 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:14.169776 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b99717d0-3c62-40aa-9b2a-36f735518bcf tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:14.170596 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-b99717d0-3c62-40aa-9b2a-36f735518bcf tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:14.177922 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b99717d0-3c62-40aa-9b2a-36f735518bcf tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:14.178376 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b99717d0-3c62-40aa-9b2a-36f735518bcf tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:14.178816 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b99717d0-3c62-40aa-9b2a-36f735518bcf tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:14.179516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b99717d0-3c62-40aa-9b2a-36f735518bcf tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:14.179973 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b99717d0-3c62-40aa-9b2a-36f735518bcf tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:14.180399 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b99717d0-3c62-40aa-9b2a-36f735518bcf tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:14.532679 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b99717d0-3c62-40aa-9b2a-36f735518bcf tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:14.541228 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b99717d0-3c62-40aa-9b2a-36f735518bcf tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1264 microversion: 2.1 time: 0.375675 Aug 17 07:32:14.554979 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 339/671] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:14 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1264 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:14.585275 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-139081d4-b1ab-43d4-a3e6-05b093fe1263 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:14.585874 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-139081d4-b1ab-43d4-a3e6-05b093fe1263 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:14.592163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-139081d4-b1ab-43d4-a3e6-05b093fe1263 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:14.592634 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-139081d4-b1ab-43d4-a3e6-05b093fe1263 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:14.593062 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-139081d4-b1ab-43d4-a3e6-05b093fe1263 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:14.593738 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-139081d4-b1ab-43d4-a3e6-05b093fe1263 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:14.594211 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-139081d4-b1ab-43d4-a3e6-05b093fe1263 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:14.594652 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-139081d4-b1ab-43d4-a3e6-05b093fe1263 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:14.722651 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-fc105066-f310-4895-af5f-7d1d443fcf85 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-827281783", "imageRef": "37843ca7-b19a-44f1-acf3-e9432324d4b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96c79c37-e502-4195-a9e7-9565916223c8"}], "security_groups": [{"name": "tempest-securitygroup--357127423"}], "key_name": "tempest-keypair-194160104", "user_data": "}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:14.724683 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-139081d4-b1ab-43d4-a3e6-05b093fe1263 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:14.732696 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-139081d4-b1ab-43d4-a3e6-05b093fe1263 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:14.734244 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-139081d4-b1ab-43d4-a3e6-05b093fe1263 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:14.735442 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-139081d4-b1ab-43d4-a3e6-05b093fe1263 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1722 microversion: 2.20 time: 0.154302 Aug 17 07:32:14.736001 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 333/672] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:14 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:14.821081 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.network.neutron [None req-fc105066-f310-4895-af5f-7d1d443fcf85 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] validate_networks() for [('96c79c37-e502-4195-a9e7-9565916223c8', None, None, None, None, None)] {{(pid=120835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:32:15.099050 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-dfb6f027-f383-4ef6-983d-e236dacd1235 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:15.099662 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-dfb6f027-f383-4ef6-983d-e236dacd1235 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:15.105539 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dfb6f027-f383-4ef6-983d-e236dacd1235 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:15.106048 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dfb6f027-f383-4ef6-983d-e236dacd1235 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:15.106487 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dfb6f027-f383-4ef6-983d-e236dacd1235 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:15.107175 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dfb6f027-f383-4ef6-983d-e236dacd1235 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:15.107631 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dfb6f027-f383-4ef6-983d-e236dacd1235 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:15.108057 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dfb6f027-f383-4ef6-983d-e236dacd1235 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:15.112109 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:15.278747 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-fc105066-f310-4895-af5f-7d1d443fcf85 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Flavor limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:32:15.279229 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-fc105066-f310-4895-af5f-7d1d443fcf85 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Image limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:32:15.279760 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-fc105066-f310-4895-af5f-7d1d443fcf85 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Flavor pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:32:15.280238 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-fc105066-f310-4895-af5f-7d1d443fcf85 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Image pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:32:15.280829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-fc105066-f310-4895-af5f-7d1d443fcf85 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:32:15.289622 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fc105066-f310-4895-af5f-7d1d443fcf85 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:15.290133 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fc105066-f310-4895-af5f-7d1d443fcf85 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:15.290568 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fc105066-f310-4895-af5f-7d1d443fcf85 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:15.291291 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fc105066-f310-4895-af5f-7d1d443fcf85 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:15.291741 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fc105066-f310-4895-af5f-7d1d443fcf85 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:15.292161 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fc105066-f310-4895-af5f-7d1d443fcf85 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:15.300269 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-dfb6f027-f383-4ef6-983d-e236dacd1235 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:15.308582 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-dfb6f027-f383-4ef6-983d-e236dacd1235 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 200 len: 1367 microversion: 2.1 time: 0.213342 Aug 17 07:32:15.309235 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 334/673] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:15 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:32:15.309583 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-fc105066-f310-4895-af5f-7d1d443fcf85 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Getting quotas for project 3c491181ae054706be3bdc94c61501f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:32:15.313544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-fc105066-f310-4895-af5f-7d1d443fcf85 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Getting quotas for user c11d183b3c0c4b2b83f3b52b881a72cf and project 3c491181ae054706be3bdc94c61501f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:32:15.325013 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-fc105066-f310-4895-af5f-7d1d443fcf85 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Going to run 1 instances... {{(pid=120835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:32:15.327359 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-fc105066-f310-4895-af5f-7d1d443fcf85 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37843ca7-b19a-44f1-acf3-e9432324d4b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:32:15.338068 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:15.374898 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-fc105066-f310-4895-af5f-7d1d443fcf85 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.657421 Aug 17 07:32:15.375545 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 340/674] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:32:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 07:32:15.387120 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a3378e47-e95d-4464-96e5-ffb78395bd35 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:15.387727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-a3378e47-e95d-4464-96e5-ffb78395bd35 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:15.441443 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a3378e47-e95d-4464-96e5-ffb78395bd35 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:15.448667 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a3378e47-e95d-4464-96e5-ffb78395bd35 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325" status: 200 len: 1236 microversion: 2.1 time: 0.065353 Aug 17 07:32:15.449234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 335/675] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:15 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:15.562740 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-743cd7b0-262c-495c-a9c2-b96e7b8e2176 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:15.563448 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-743cd7b0-262c-495c-a9c2-b96e7b8e2176 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:15.570923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-743cd7b0-262c-495c-a9c2-b96e7b8e2176 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:15.571579 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-743cd7b0-262c-495c-a9c2-b96e7b8e2176 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:15.572183 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-743cd7b0-262c-495c-a9c2-b96e7b8e2176 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:15.572888 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-743cd7b0-262c-495c-a9c2-b96e7b8e2176 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:15.573348 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-743cd7b0-262c-495c-a9c2-b96e7b8e2176 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:15.573783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-743cd7b0-262c-495c-a9c2-b96e7b8e2176 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:15.708057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-743cd7b0-262c-495c-a9c2-b96e7b8e2176 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:15.715778 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-743cd7b0-262c-495c-a9c2-b96e7b8e2176 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1264 microversion: 2.1 time: 0.156908 Aug 17 07:32:15.716326 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 341/676] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:15 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:15.758275 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-498df5cd-fdc5-4ddf-b5ef-40778c2b514b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:15.758884 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-498df5cd-fdc5-4ddf-b5ef-40778c2b514b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:15.765809 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-498df5cd-fdc5-4ddf-b5ef-40778c2b514b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:15.766323 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-498df5cd-fdc5-4ddf-b5ef-40778c2b514b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:15.766757 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-498df5cd-fdc5-4ddf-b5ef-40778c2b514b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:15.767438 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-498df5cd-fdc5-4ddf-b5ef-40778c2b514b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:15.767889 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-498df5cd-fdc5-4ddf-b5ef-40778c2b514b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:15.768343 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-498df5cd-fdc5-4ddf-b5ef-40778c2b514b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:15.898912 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-498df5cd-fdc5-4ddf-b5ef-40778c2b514b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:15.906904 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-498df5cd-fdc5-4ddf-b5ef-40778c2b514b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:15.908404 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-498df5cd-fdc5-4ddf-b5ef-40778c2b514b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:15.910087 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-498df5cd-fdc5-4ddf-b5ef-40778c2b514b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1722 microversion: 2.20 time: 0.155697 Aug 17 07:32:15.910639 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 336/677] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:15 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:16.133383 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-f110708f-a649-4b63-a94c-bd8120f275ca req-e8ac444d-1d25-4be6-9d55-ad706bc789c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8429d063-003c-4918-85d8-7746d852a8be", "name": "network-vif-plugged", "status": "completed", "tag": "4929a810-8ffb-4736-afb2-d5142a3cb211"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:16.147347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-f110708f-a649-4b63-a94c-bd8120f275ca req-e8ac444d-1d25-4be6-9d55-ad706bc789c3 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:16.147821 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-f110708f-a649-4b63-a94c-bd8120f275ca req-e8ac444d-1d25-4be6-9d55-ad706bc789c3 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:16.148242 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-f110708f-a649-4b63-a94c-bd8120f275ca req-e8ac444d-1d25-4be6-9d55-ad706bc789c3 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:16.168624 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-f110708f-a649-4b63-a94c-bd8120f275ca req-e8ac444d-1d25-4be6-9d55-ad706bc789c3 service nova] Creating event network-vif-plugged:4929a810-8ffb-4736-afb2-d5142a3cb211 for instance 8429d063-003c-4918-85d8-7746d852a8be on hv-cinder-85312 Aug 17 07:32:16.174155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-f110708f-a649-4b63-a94c-bd8120f275ca req-e8ac444d-1d25-4be6-9d55-ad706bc789c3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044801 Aug 17 07:32:16.175064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 342/678] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:16.328528 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b04b90a4-8269-49a0-8c36-3719f3208828 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:16.329222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-b04b90a4-8269-49a0-8c36-3719f3208828 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:16.335536 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b04b90a4-8269-49a0-8c36-3719f3208828 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:16.336022 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b04b90a4-8269-49a0-8c36-3719f3208828 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:16.336440 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b04b90a4-8269-49a0-8c36-3719f3208828 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:16.337129 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b04b90a4-8269-49a0-8c36-3719f3208828 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:16.337575 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b04b90a4-8269-49a0-8c36-3719f3208828 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:16.338018 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b04b90a4-8269-49a0-8c36-3719f3208828 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:16.471673 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-b04b90a4-8269-49a0-8c36-3719f3208828 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:16.474830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ca1c13eb-c413-4c0d-b995-d77927baec31 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:16.475564 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-ca1c13eb-c413-4c0d-b995-d77927baec31 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:16.481761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ca1c13eb-c413-4c0d-b995-d77927baec31 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:16.485708 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ca1c13eb-c413-4c0d-b995-d77927baec31 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:16.486350 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ca1c13eb-c413-4c0d-b995-d77927baec31 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:16.487292 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ca1c13eb-c413-4c0d-b995-d77927baec31 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:16.487725 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ca1c13eb-c413-4c0d-b995-d77927baec31 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:16.488070 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b04b90a4-8269-49a0-8c36-3719f3208828 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 200 len: 1367 microversion: 2.1 time: 0.163246 Aug 17 07:32:16.488327 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ca1c13eb-c413-4c0d-b995-d77927baec31 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:16.501224 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 337/679] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:16 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:16.563462 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ca1c13eb-c413-4c0d-b995-d77927baec31 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:16.571572 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-ca1c13eb-c413-4c0d-b995-d77927baec31 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325" status: 200 len: 1288 microversion: 2.1 time: 0.106175 Aug 17 07:32:16.572430 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 343/680] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:16 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 => generated 1288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:16.736754 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-4271aabb-9d6a-4fcf-bb4a-cc1955175293 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:16.737354 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-4271aabb-9d6a-4fcf-bb4a-cc1955175293 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:16.743388 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4271aabb-9d6a-4fcf-bb4a-cc1955175293 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:16.743860 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4271aabb-9d6a-4fcf-bb4a-cc1955175293 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:16.744289 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4271aabb-9d6a-4fcf-bb4a-cc1955175293 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:16.744962 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4271aabb-9d6a-4fcf-bb4a-cc1955175293 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:16.745410 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4271aabb-9d6a-4fcf-bb4a-cc1955175293 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:16.745828 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4271aabb-9d6a-4fcf-bb4a-cc1955175293 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:16.873996 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-4271aabb-9d6a-4fcf-bb4a-cc1955175293 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:16.881897 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-4271aabb-9d6a-4fcf-bb4a-cc1955175293 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1264 microversion: 2.1 time: 0.149057 Aug 17 07:32:16.882488 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 338/681] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:16 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:16.933017 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b96f84e8-0f04-42d2-b78b-d1c5c02f21a0 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:16.933627 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-b96f84e8-0f04-42d2-b78b-d1c5c02f21a0 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:16.939497 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b96f84e8-0f04-42d2-b78b-d1c5c02f21a0 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:16.939967 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b96f84e8-0f04-42d2-b78b-d1c5c02f21a0 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:16.940398 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b96f84e8-0f04-42d2-b78b-d1c5c02f21a0 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:16.941712 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b96f84e8-0f04-42d2-b78b-d1c5c02f21a0 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:16.942229 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b96f84e8-0f04-42d2-b78b-d1c5c02f21a0 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:16.942654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b96f84e8-0f04-42d2-b78b-d1c5c02f21a0 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:17.072331 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b96f84e8-0f04-42d2-b78b-d1c5c02f21a0 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:17.082236 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b96f84e8-0f04-42d2-b78b-d1c5c02f21a0 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:17.083755 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b96f84e8-0f04-42d2-b78b-d1c5c02f21a0 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:17.084928 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b96f84e8-0f04-42d2-b78b-d1c5c02f21a0 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1722 microversion: 2.20 time: 0.155896 Aug 17 07:32:17.085496 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 344/682] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:16 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:32:17.509833 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-fca73bf8-6044-4fbb-827d-aa243bce8fe9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:17.510314 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-fca73bf8-6044-4fbb-827d-aa243bce8fe9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:17.513109 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=2 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:17.516931 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fca73bf8-6044-4fbb-827d-aa243bce8fe9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:17.517422 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fca73bf8-6044-4fbb-827d-aa243bce8fe9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:17.517882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fca73bf8-6044-4fbb-827d-aa243bce8fe9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:17.518614 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fca73bf8-6044-4fbb-827d-aa243bce8fe9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:17.519071 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fca73bf8-6044-4fbb-827d-aa243bce8fe9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:17.519534 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fca73bf8-6044-4fbb-827d-aa243bce8fe9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:17.592767 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-072a22d1-721b-4831-a3ec-4e75c3512756 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:17.593295 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-072a22d1-721b-4831-a3ec-4e75c3512756 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:17.599771 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-072a22d1-721b-4831-a3ec-4e75c3512756 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:17.600474 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-072a22d1-721b-4831-a3ec-4e75c3512756 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:17.600643 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-072a22d1-721b-4831-a3ec-4e75c3512756 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:17.601376 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-072a22d1-721b-4831-a3ec-4e75c3512756 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:17.601832 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-072a22d1-721b-4831-a3ec-4e75c3512756 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:17.602307 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-072a22d1-721b-4831-a3ec-4e75c3512756 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:17.677239 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-072a22d1-721b-4831-a3ec-4e75c3512756 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:17.681466 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-fca73bf8-6044-4fbb-827d-aa243bce8fe9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:17.685678 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-072a22d1-721b-4831-a3ec-4e75c3512756 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325" status: 200 len: 1294 microversion: 2.1 time: 0.096622 Aug 17 07:32:17.698055 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 345/683] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:17 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 => generated 1294 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:32:17.698453 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-fca73bf8-6044-4fbb-827d-aa243bce8fe9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 200 len: 1367 microversion: 2.1 time: 0.183620 Aug 17 07:32:17.698453 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 339/684] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:17 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:17.901845 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-53403b7e-4449-478d-bccd-a1ccf50d811a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:17.902505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-53403b7e-4449-478d-bccd-a1ccf50d811a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:17.908413 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53403b7e-4449-478d-bccd-a1ccf50d811a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:17.908961 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53403b7e-4449-478d-bccd-a1ccf50d811a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:17.909459 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53403b7e-4449-478d-bccd-a1ccf50d811a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:17.910704 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53403b7e-4449-478d-bccd-a1ccf50d811a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:17.911171 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53403b7e-4449-478d-bccd-a1ccf50d811a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:17.911596 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53403b7e-4449-478d-bccd-a1ccf50d811a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:18.061039 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-53403b7e-4449-478d-bccd-a1ccf50d811a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:18.069647 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-53403b7e-4449-478d-bccd-a1ccf50d811a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1264 microversion: 2.1 time: 0.171544 Aug 17 07:32:18.070871 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 346/685] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:17 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:18.107950 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-38e8ad3a-d747-4355-a9e3-d43cd7ebe72b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:18.108948 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-38e8ad3a-d747-4355-a9e3-d43cd7ebe72b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:18.116376 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-38e8ad3a-d747-4355-a9e3-d43cd7ebe72b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:18.116862 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-38e8ad3a-d747-4355-a9e3-d43cd7ebe72b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:18.117550 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-38e8ad3a-d747-4355-a9e3-d43cd7ebe72b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:18.118352 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-38e8ad3a-d747-4355-a9e3-d43cd7ebe72b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:18.118955 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-38e8ad3a-d747-4355-a9e3-d43cd7ebe72b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:18.119618 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-38e8ad3a-d747-4355-a9e3-d43cd7ebe72b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:18.289888 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-38e8ad3a-d747-4355-a9e3-d43cd7ebe72b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:18.298029 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-38e8ad3a-d747-4355-a9e3-d43cd7ebe72b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:18.299545 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-38e8ad3a-d747-4355-a9e3-d43cd7ebe72b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:18.301741 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-38e8ad3a-d747-4355-a9e3-d43cd7ebe72b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1722 microversion: 2.20 time: 0.196948 Aug 17 07:32:18.302426 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 340/686] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:18 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:18.709318 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e99d4d98-fb20-497b-86fd-d82976a3b135 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:18.709925 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e99d4d98-fb20-497b-86fd-d82976a3b135 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:18.711842 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-336cccde-58f0-4e95-86fb-a433c20cb8b6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:18.712454 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-336cccde-58f0-4e95-86fb-a433c20cb8b6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:18.719607 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-336cccde-58f0-4e95-86fb-a433c20cb8b6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:18.720060 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-336cccde-58f0-4e95-86fb-a433c20cb8b6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:18.720820 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-336cccde-58f0-4e95-86fb-a433c20cb8b6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:18.721418 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e99d4d98-fb20-497b-86fd-d82976a3b135 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:18.721909 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e99d4d98-fb20-497b-86fd-d82976a3b135 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:18.722472 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e99d4d98-fb20-497b-86fd-d82976a3b135 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:18.723202 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e99d4d98-fb20-497b-86fd-d82976a3b135 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:18.723626 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e99d4d98-fb20-497b-86fd-d82976a3b135 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:18.724051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e99d4d98-fb20-497b-86fd-d82976a3b135 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:18.725396 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-336cccde-58f0-4e95-86fb-a433c20cb8b6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:18.725859 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-336cccde-58f0-4e95-86fb-a433c20cb8b6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:18.726322 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-336cccde-58f0-4e95-86fb-a433c20cb8b6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:18.929622 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-336cccde-58f0-4e95-86fb-a433c20cb8b6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:18.939369 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-336cccde-58f0-4e95-86fb-a433c20cb8b6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 200 len: 1367 microversion: 2.1 time: 0.232427 Aug 17 07:32:18.940070 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 341/687] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:18 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:32:18.946223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-e99d4d98-fb20-497b-86fd-d82976a3b135 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:18.954647 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e99d4d98-fb20-497b-86fd-d82976a3b135 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325" status: 200 len: 1361 microversion: 2.1 time: 0.249769 Aug 17 07:32:18.955426 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 347/688] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:18 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 => generated 1361 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:19.090903 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-6acca7c1-f78d-494f-9fe4-1e554a3d4707 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:19.091505 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-6acca7c1-f78d-494f-9fe4-1e554a3d4707 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:19.097638 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6acca7c1-f78d-494f-9fe4-1e554a3d4707 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:19.098246 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6acca7c1-f78d-494f-9fe4-1e554a3d4707 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:19.098688 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6acca7c1-f78d-494f-9fe4-1e554a3d4707 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:19.099382 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6acca7c1-f78d-494f-9fe4-1e554a3d4707 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:19.099833 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6acca7c1-f78d-494f-9fe4-1e554a3d4707 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:19.100264 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6acca7c1-f78d-494f-9fe4-1e554a3d4707 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:19.234903 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-6acca7c1-f78d-494f-9fe4-1e554a3d4707 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:19.243822 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-6acca7c1-f78d-494f-9fe4-1e554a3d4707 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1450 microversion: 2.1 time: 0.156714 Aug 17 07:32:19.244397 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 342/689] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:19 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:19.265681 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-1f18c3f2-fc22-438b-871e-11fbf603bea4 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:19.266526 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-1f18c3f2-fc22-438b-871e-11fbf603bea4 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:19.273073 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1f18c3f2-fc22-438b-871e-11fbf603bea4 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:19.273666 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1f18c3f2-fc22-438b-871e-11fbf603bea4 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:19.274246 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1f18c3f2-fc22-438b-871e-11fbf603bea4 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:19.274958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1f18c3f2-fc22-438b-871e-11fbf603bea4 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:19.275385 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1f18c3f2-fc22-438b-871e-11fbf603bea4 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:19.275804 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1f18c3f2-fc22-438b-871e-11fbf603bea4 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:19.324998 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c9abd057-02e1-4a69-8b19-aafb8d9a6ef4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:19.325598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c9abd057-02e1-4a69-8b19-aafb8d9a6ef4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:19.331454 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c9abd057-02e1-4a69-8b19-aafb8d9a6ef4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:19.331967 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c9abd057-02e1-4a69-8b19-aafb8d9a6ef4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:19.332398 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c9abd057-02e1-4a69-8b19-aafb8d9a6ef4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:19.333077 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c9abd057-02e1-4a69-8b19-aafb8d9a6ef4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:19.333720 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c9abd057-02e1-4a69-8b19-aafb8d9a6ef4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:19.334175 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c9abd057-02e1-4a69-8b19-aafb8d9a6ef4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:19.479283 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-1f18c3f2-fc22-438b-871e-11fbf603bea4 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:19.495641 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-1f18c3f2-fc22-438b-871e-11fbf603bea4 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1450 microversion: 2.1 time: 0.234341 Aug 17 07:32:19.496313 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 348/690] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:19 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1450 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:19.509732 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c9abd057-02e1-4a69-8b19-aafb8d9a6ef4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:19.519050 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c9abd057-02e1-4a69-8b19-aafb8d9a6ef4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:19.520697 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c9abd057-02e1-4a69-8b19-aafb8d9a6ef4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:19.522099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c9abd057-02e1-4a69-8b19-aafb8d9a6ef4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1722 microversion: 2.20 time: 0.200809 Aug 17 07:32:19.530140 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 343/691] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:19 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:32:19.621164 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-455af02e-ad97-4fcd-a58d-e2355e20c286 req-5600dc6b-3897-48f6-852b-15669d09865b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325", "tag": "92cee9b4-b45b-4de3-a2a7-2bfe79574445"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:19.631963 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-455af02e-ad97-4fcd-a58d-e2355e20c286 req-5600dc6b-3897-48f6-852b-15669d09865b service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:19.633214 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-455af02e-ad97-4fcd-a58d-e2355e20c286 req-5600dc6b-3897-48f6-852b-15669d09865b service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:19.633815 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-455af02e-ad97-4fcd-a58d-e2355e20c286 req-5600dc6b-3897-48f6-852b-15669d09865b service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:19.649516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-455af02e-ad97-4fcd-a58d-e2355e20c286 req-5600dc6b-3897-48f6-852b-15669d09865b service nova] Creating event network-changed:92cee9b4-b45b-4de3-a2a7-2bfe79574445 for instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 on hv-cinder-85312 Aug 17 07:32:19.654238 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-455af02e-ad97-4fcd-a58d-e2355e20c286 req-5600dc6b-3897-48f6-852b-15669d09865b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036963 Aug 17 07:32:19.655164 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 349/692] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:19.961317 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-4fdd3822-5631-4bc6-b1f6-b20a3dfac066 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:19.962174 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-4fdd3822-5631-4bc6-b1f6-b20a3dfac066 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:19.968103 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4fdd3822-5631-4bc6-b1f6-b20a3dfac066 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:19.968783 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4fdd3822-5631-4bc6-b1f6-b20a3dfac066 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:19.969373 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4fdd3822-5631-4bc6-b1f6-b20a3dfac066 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:19.970312 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4fdd3822-5631-4bc6-b1f6-b20a3dfac066 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:19.970911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4fdd3822-5631-4bc6-b1f6-b20a3dfac066 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:19.971997 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4fdd3822-5631-4bc6-b1f6-b20a3dfac066 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:19.979511 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-57a76d8e-85ce-4e02-8115-f91c411a5e05 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:19.981277 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-57a76d8e-85ce-4e02-8115-f91c411a5e05 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:19.988235 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57a76d8e-85ce-4e02-8115-f91c411a5e05 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:19.989383 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57a76d8e-85ce-4e02-8115-f91c411a5e05 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:19.990129 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57a76d8e-85ce-4e02-8115-f91c411a5e05 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:19.991057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57a76d8e-85ce-4e02-8115-f91c411a5e05 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:19.991715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57a76d8e-85ce-4e02-8115-f91c411a5e05 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:19.992663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-57a76d8e-85ce-4e02-8115-f91c411a5e05 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:20.336975 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-4fdd3822-5631-4bc6-b1f6-b20a3dfac066 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:20.344777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-4fdd3822-5631-4bc6-b1f6-b20a3dfac066 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 200 len: 1367 microversion: 2.1 time: 0.387904 Aug 17 07:32:20.345352 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 344/693] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:19 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 1367 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:20.362597 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-57a76d8e-85ce-4e02-8115-f91c411a5e05 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:20.374972 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-944bf051-9ae2-4556-9c30-dd28bee3c164 req-7718adcd-a172-4452-a46b-5faf3662e62f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7dc7f93-7079-4b42-a379-f28a28546aaa", "name": "network-vif-plugged", "status": "completed", "tag": "40775ac5-a507-4994-a119-9ac097c452e5"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:20.375438 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-57a76d8e-85ce-4e02-8115-f91c411a5e05 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325" status: 200 len: 1361 microversion: 2.1 time: 0.402141 Aug 17 07:32:20.376607 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 350/694] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:19 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 => generated 1361 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:32:20.394280 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-944bf051-9ae2-4556-9c30-dd28bee3c164 req-7718adcd-a172-4452-a46b-5faf3662e62f service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:20.395636 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-944bf051-9ae2-4556-9c30-dd28bee3c164 req-7718adcd-a172-4452-a46b-5faf3662e62f service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:20.396074 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-944bf051-9ae2-4556-9c30-dd28bee3c164 req-7718adcd-a172-4452-a46b-5faf3662e62f service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:20.407377 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-944bf051-9ae2-4556-9c30-dd28bee3c164 req-7718adcd-a172-4452-a46b-5faf3662e62f service nova] Creating event network-vif-plugged:40775ac5-a507-4994-a119-9ac097c452e5 for instance f7dc7f93-7079-4b42-a379-f28a28546aaa on hv-cinder-85312 Aug 17 07:32:20.412955 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-944bf051-9ae2-4556-9c30-dd28bee3c164 req-7718adcd-a172-4452-a46b-5faf3662e62f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048289 Aug 17 07:32:20.413556 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 345/695] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:20.546418 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-25a49c59-8975-4054-875f-8facf954b7d2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:20.547032 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-25a49c59-8975-4054-875f-8facf954b7d2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:20.553186 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-25a49c59-8975-4054-875f-8facf954b7d2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:20.553674 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-25a49c59-8975-4054-875f-8facf954b7d2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:20.554148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-25a49c59-8975-4054-875f-8facf954b7d2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:20.554836 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-25a49c59-8975-4054-875f-8facf954b7d2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:20.555450 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-25a49c59-8975-4054-875f-8facf954b7d2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:20.556043 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-25a49c59-8975-4054-875f-8facf954b7d2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:20.759263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-25a49c59-8975-4054-875f-8facf954b7d2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:20.768120 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-25a49c59-8975-4054-875f-8facf954b7d2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:20.770633 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-25a49c59-8975-4054-875f-8facf954b7d2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:20.771798 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-25a49c59-8975-4054-875f-8facf954b7d2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1722 microversion: 2.20 time: 0.229259 Aug 17 07:32:20.772511 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 351/696] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:20 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:21.366205 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-882f1b8e-98fb-469f-b3dc-b7ffcc78aff9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:21.367312 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-882f1b8e-98fb-469f-b3dc-b7ffcc78aff9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:21.373882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-882f1b8e-98fb-469f-b3dc-b7ffcc78aff9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:21.374402 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-882f1b8e-98fb-469f-b3dc-b7ffcc78aff9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:21.374839 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-882f1b8e-98fb-469f-b3dc-b7ffcc78aff9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:21.375539 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-882f1b8e-98fb-469f-b3dc-b7ffcc78aff9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:21.376005 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-882f1b8e-98fb-469f-b3dc-b7ffcc78aff9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:21.376420 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-882f1b8e-98fb-469f-b3dc-b7ffcc78aff9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:21.397492 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d9083179-32d6-47c5-a35b-26a5807fc722 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:21.398709 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d9083179-32d6-47c5-a35b-26a5807fc722 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:21.418179 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d9083179-32d6-47c5-a35b-26a5807fc722 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:21.419917 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d9083179-32d6-47c5-a35b-26a5807fc722 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:21.423549 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d9083179-32d6-47c5-a35b-26a5807fc722 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:21.424579 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d9083179-32d6-47c5-a35b-26a5807fc722 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:21.426214 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d9083179-32d6-47c5-a35b-26a5807fc722 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:21.426666 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d9083179-32d6-47c5-a35b-26a5807fc722 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:21.437076 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=100 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:21.649930 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-882f1b8e-98fb-469f-b3dc-b7ffcc78aff9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:21.663676 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-882f1b8e-98fb-469f-b3dc-b7ffcc78aff9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 200 len: 1367 microversion: 2.1 time: 0.301863 Aug 17 07:32:21.676886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d9083179-32d6-47c5-a35b-26a5807fc722 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:21.678385 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 346/697] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:21 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:21.683532 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-d9e5f8b0-9bdd-4d25-ab05-0af21725c78d req-6075e315-1567-4394-8b9d-a9572c2afd7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8429d063-003c-4918-85d8-7746d852a8be", "tag": "4929a810-8ffb-4736-afb2-d5142a3cb211"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:21.689886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d9083179-32d6-47c5-a35b-26a5807fc722 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325" status: 200 len: 1361 microversion: 2.1 time: 0.296445 Aug 17 07:32:21.694550 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-d9e5f8b0-9bdd-4d25-ab05-0af21725c78d req-6075e315-1567-4394-8b9d-a9572c2afd7a service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:21.695235 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-d9e5f8b0-9bdd-4d25-ab05-0af21725c78d req-6075e315-1567-4394-8b9d-a9572c2afd7a service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:21.695887 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-d9e5f8b0-9bdd-4d25-ab05-0af21725c78d req-6075e315-1567-4394-8b9d-a9572c2afd7a service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:21.707671 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 352/698] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:21 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 => generated 1361 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:32:21.708449 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-d9e5f8b0-9bdd-4d25-ab05-0af21725c78d req-6075e315-1567-4394-8b9d-a9572c2afd7a service nova] Creating event network-changed:4929a810-8ffb-4736-afb2-d5142a3cb211 for instance 8429d063-003c-4918-85d8-7746d852a8be on hv-cinder-85312 Aug 17 07:32:21.714004 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-d9e5f8b0-9bdd-4d25-ab05-0af21725c78d req-6075e315-1567-4394-8b9d-a9572c2afd7a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034387 Aug 17 07:32:21.714750 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 347/699] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:21.795638 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d18273cc-41a3-4a4f-80f8-baf026e52fa3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:21.796394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d18273cc-41a3-4a4f-80f8-baf026e52fa3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:21.802250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d18273cc-41a3-4a4f-80f8-baf026e52fa3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:21.802821 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d18273cc-41a3-4a4f-80f8-baf026e52fa3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:21.803259 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d18273cc-41a3-4a4f-80f8-baf026e52fa3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:21.803942 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d18273cc-41a3-4a4f-80f8-baf026e52fa3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:21.804387 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d18273cc-41a3-4a4f-80f8-baf026e52fa3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:21.804959 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d18273cc-41a3-4a4f-80f8-baf026e52fa3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:21.969632 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d18273cc-41a3-4a4f-80f8-baf026e52fa3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:21.994775 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d18273cc-41a3-4a4f-80f8-baf026e52fa3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:21.996804 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d18273cc-41a3-4a4f-80f8-baf026e52fa3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:21.998215 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d18273cc-41a3-4a4f-80f8-baf026e52fa3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1722 microversion: 2.20 time: 0.206413 Aug 17 07:32:21.999281 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 353/700] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:21 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:32:22.685828 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-fcf4f45d-84e3-4edb-ada6-1f85cbbd4747 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:22.687264 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-fcf4f45d-84e3-4edb-ada6-1f85cbbd4747 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:22.693713 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fcf4f45d-84e3-4edb-ada6-1f85cbbd4747 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:22.694219 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fcf4f45d-84e3-4edb-ada6-1f85cbbd4747 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:22.694657 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fcf4f45d-84e3-4edb-ada6-1f85cbbd4747 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:22.695366 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fcf4f45d-84e3-4edb-ada6-1f85cbbd4747 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:22.695819 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fcf4f45d-84e3-4edb-ada6-1f85cbbd4747 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:22.696423 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-fcf4f45d-84e3-4edb-ada6-1f85cbbd4747 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:22.722213 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2a00e1e7-9708-4c49-a084-f5ddd17028a6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:22.724171 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-2a00e1e7-9708-4c49-a084-f5ddd17028a6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:22.730853 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a00e1e7-9708-4c49-a084-f5ddd17028a6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:22.731455 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a00e1e7-9708-4c49-a084-f5ddd17028a6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:22.732257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a00e1e7-9708-4c49-a084-f5ddd17028a6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:22.733123 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a00e1e7-9708-4c49-a084-f5ddd17028a6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:22.733676 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a00e1e7-9708-4c49-a084-f5ddd17028a6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:22.734237 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a00e1e7-9708-4c49-a084-f5ddd17028a6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:23.168426 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-fcf4f45d-84e3-4edb-ada6-1f85cbbd4747 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:23.172436 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2a00e1e7-9708-4c49-a084-f5ddd17028a6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:23.176871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-fcf4f45d-84e3-4edb-ada6-1f85cbbd4747 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 200 len: 1558 microversion: 2.1 time: 0.495516 Aug 17 07:32:23.177445 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 348/701] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:22 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 1558 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:23.181984 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-5383e5f3-d434-472d-9e3f-a04147f2e74d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:23.182567 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-5383e5f3-d434-472d-9e3f-a04147f2e74d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:23.184100 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-2a00e1e7-9708-4c49-a084-f5ddd17028a6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325" status: 200 len: 1361 microversion: 2.1 time: 0.465934 Aug 17 07:32:23.184818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 354/702] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:22 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 => generated 1361 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:23.188574 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5383e5f3-d434-472d-9e3f-a04147f2e74d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:23.189047 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5383e5f3-d434-472d-9e3f-a04147f2e74d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:23.189476 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5383e5f3-d434-472d-9e3f-a04147f2e74d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:23.190191 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5383e5f3-d434-472d-9e3f-a04147f2e74d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:23.190639 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5383e5f3-d434-472d-9e3f-a04147f2e74d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:23.191116 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5383e5f3-d434-472d-9e3f-a04147f2e74d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:23.196384 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-09fc1ead-91cd-417a-8e14-45be472e435a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:23.197104 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-09fc1ead-91cd-417a-8e14-45be472e435a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:23.203984 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-09fc1ead-91cd-417a-8e14-45be472e435a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:23.204469 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-09fc1ead-91cd-417a-8e14-45be472e435a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:23.204906 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-09fc1ead-91cd-417a-8e14-45be472e435a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:23.205612 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-09fc1ead-91cd-417a-8e14-45be472e435a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:23.206078 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-09fc1ead-91cd-417a-8e14-45be472e435a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:23.206512 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-09fc1ead-91cd-417a-8e14-45be472e435a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:23.309221 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-09fc1ead-91cd-417a-8e14-45be472e435a tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116497 Aug 17 07:32:23.309824 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 355/703] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 17 07:32:23 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:32:23.352099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-5383e5f3-d434-472d-9e3f-a04147f2e74d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:23.360065 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-5383e5f3-d434-472d-9e3f-a04147f2e74d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:23.361560 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-5383e5f3-d434-472d-9e3f-a04147f2e74d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:23.363860 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-5383e5f3-d434-472d-9e3f-a04147f2e74d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1722 microversion: 2.20 time: 0.184875 Aug 17 07:32:23.364409 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 349/704] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:23 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:23.470928 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-8f718b0f-453d-4e81-9662-59e7d06903fd tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-234610702", "imageRef": "37843ca7-b19a-44f1-acf3-e9432324d4b2", "flavorRef": "452"}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:23.530064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.network.neutron [None req-8f718b0f-453d-4e81-9662-59e7d06903fd tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] validate_networks() for None {{(pid=120835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:32:23.819813 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-8f718b0f-453d-4e81-9662-59e7d06903fd tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Flavor limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:32:23.820390 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-8f718b0f-453d-4e81-9662-59e7d06903fd tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Image limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:32:23.821352 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-8f718b0f-453d-4e81-9662-59e7d06903fd tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Flavor pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:32:23.821862 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-8f718b0f-453d-4e81-9662-59e7d06903fd tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Image pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:32:23.822350 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-8f718b0f-453d-4e81-9662-59e7d06903fd tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:32:23.832035 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8f718b0f-453d-4e81-9662-59e7d06903fd tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:23.833007 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8f718b0f-453d-4e81-9662-59e7d06903fd tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:23.833568 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8f718b0f-453d-4e81-9662-59e7d06903fd tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:23.834341 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8f718b0f-453d-4e81-9662-59e7d06903fd tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:23.834892 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8f718b0f-453d-4e81-9662-59e7d06903fd tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:23.835392 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8f718b0f-453d-4e81-9662-59e7d06903fd tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:23.854031 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-8f718b0f-453d-4e81-9662-59e7d06903fd tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Getting quotas for project fecc5bbb9bd84c58af2302dcde767691. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:32:23.858043 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-8f718b0f-453d-4e81-9662-59e7d06903fd tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Getting quotas for user 3b8a70d6cf4a46ea9b4de37a34ce97d6 and project fecc5bbb9bd84c58af2302dcde767691. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:32:23.870273 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-8f718b0f-453d-4e81-9662-59e7d06903fd tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Going to run 1 instances... {{(pid=120835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:32:23.872986 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-8f718b0f-453d-4e81-9662-59e7d06903fd tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37843ca7-b19a-44f1-acf3-e9432324d4b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:32:23.925188 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-8f718b0f-453d-4e81-9662-59e7d06903fd tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.457959 Aug 17 07:32:23.926423 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 356/705] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:32:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 07:32:23.937576 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-62954ac2-4ccc-4bcc-a95b-8bedcb7593f5 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:23.938208 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-62954ac2-4ccc-4bcc-a95b-8bedcb7593f5 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:23.993127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-62954ac2-4ccc-4bcc-a95b-8bedcb7593f5 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:23.995440 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=21 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:24.001399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-62954ac2-4ccc-4bcc-a95b-8bedcb7593f5 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1214 microversion: 2.1 time: 0.067585 Aug 17 07:32:24.002573 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 350/706] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:23 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:24.171416 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-8098cf21-9f92-48e4-893e-dbd3d53e2d25 req-990109c6-e9fe-4aee-8ee5-9fcddb7c2069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325", "name": "network-vif-plugged", "status": "completed", "tag": "92cee9b4-b45b-4de3-a2a7-2bfe79574445"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:24.184568 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-8098cf21-9f92-48e4-893e-dbd3d53e2d25 req-990109c6-e9fe-4aee-8ee5-9fcddb7c2069 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:24.185230 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-8098cf21-9f92-48e4-893e-dbd3d53e2d25 req-990109c6-e9fe-4aee-8ee5-9fcddb7c2069 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:24.186016 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-8098cf21-9f92-48e4-893e-dbd3d53e2d25 req-990109c6-e9fe-4aee-8ee5-9fcddb7c2069 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:24.200165 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-8098cf21-9f92-48e4-893e-dbd3d53e2d25 req-990109c6-e9fe-4aee-8ee5-9fcddb7c2069 service nova] Creating event network-vif-plugged:92cee9b4-b45b-4de3-a2a7-2bfe79574445 for instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 on hv-cinder-85312 Aug 17 07:32:24.204522 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-57702ea1-b7db-4f63-8c85-679e0323877e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:24.205321 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-57702ea1-b7db-4f63-8c85-679e0323877e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:24.206579 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-8098cf21-9f92-48e4-893e-dbd3d53e2d25 req-990109c6-e9fe-4aee-8ee5-9fcddb7c2069 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038862 Aug 17 07:32:24.208258 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 357/707] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:24.223764 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-57702ea1-b7db-4f63-8c85-679e0323877e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:24.224527 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-57702ea1-b7db-4f63-8c85-679e0323877e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:24.225139 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-57702ea1-b7db-4f63-8c85-679e0323877e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:24.225656 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-57702ea1-b7db-4f63-8c85-679e0323877e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:24.226135 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-57702ea1-b7db-4f63-8c85-679e0323877e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:24.226722 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-57702ea1-b7db-4f63-8c85-679e0323877e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:24.389856 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e2c5b1d4-c5c6-468f-a2fd-c980ae3a0328 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:24.393570 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e2c5b1d4-c5c6-468f-a2fd-c980ae3a0328 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:24.397198 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-57702ea1-b7db-4f63-8c85-679e0323877e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:24.402412 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e2c5b1d4-c5c6-468f-a2fd-c980ae3a0328 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:24.403007 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e2c5b1d4-c5c6-468f-a2fd-c980ae3a0328 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:24.403339 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e2c5b1d4-c5c6-468f-a2fd-c980ae3a0328 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:24.404321 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e2c5b1d4-c5c6-468f-a2fd-c980ae3a0328 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:24.404783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e2c5b1d4-c5c6-468f-a2fd-c980ae3a0328 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:24.405566 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e2c5b1d4-c5c6-468f-a2fd-c980ae3a0328 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:24.412524 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-57702ea1-b7db-4f63-8c85-679e0323877e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325" status: 200 len: 1361 microversion: 2.1 time: 0.211654 Aug 17 07:32:24.413238 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 351/708] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:24 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:32:24.417904 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-64753eee-fcad-4604-9836-4321b7f8c415 req-1f4beb78-ad23-4382-a007-77b238dc8ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7dc7f93-7079-4b42-a379-f28a28546aaa", "tag": "40775ac5-a507-4994-a119-9ac097c452e5"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:24.445942 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-64753eee-fcad-4604-9836-4321b7f8c415 req-1f4beb78-ad23-4382-a007-77b238dc8ff9 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:24.446459 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-64753eee-fcad-4604-9836-4321b7f8c415 req-1f4beb78-ad23-4382-a007-77b238dc8ff9 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:24.446870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-64753eee-fcad-4604-9836-4321b7f8c415 req-1f4beb78-ad23-4382-a007-77b238dc8ff9 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:24.460510 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-64753eee-fcad-4604-9836-4321b7f8c415 req-1f4beb78-ad23-4382-a007-77b238dc8ff9 service nova] Creating event network-changed:40775ac5-a507-4994-a119-9ac097c452e5 for instance f7dc7f93-7079-4b42-a379-f28a28546aaa on hv-cinder-85312 Aug 17 07:32:24.477766 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-64753eee-fcad-4604-9836-4321b7f8c415 req-1f4beb78-ad23-4382-a007-77b238dc8ff9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051150 Aug 17 07:32:24.478872 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 352/709] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:24.590827 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-e2c5b1d4-c5c6-468f-a2fd-c980ae3a0328 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:24.599354 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-e2c5b1d4-c5c6-468f-a2fd-c980ae3a0328 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:24.600853 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-e2c5b1d4-c5c6-468f-a2fd-c980ae3a0328 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:24.602031 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e2c5b1d4-c5c6-468f-a2fd-c980ae3a0328 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1722 microversion: 2.20 time: 0.218866 Aug 17 07:32:24.602595 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 358/710] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:24 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:32:25.023798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9b28e4c9-d24b-407e-b6ee-f284f79c2a18 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:25.024516 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9b28e4c9-d24b-407e-b6ee-f284f79c2a18 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:25.030929 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9b28e4c9-d24b-407e-b6ee-f284f79c2a18 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:25.031427 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9b28e4c9-d24b-407e-b6ee-f284f79c2a18 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:25.031854 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9b28e4c9-d24b-407e-b6ee-f284f79c2a18 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:25.032533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9b28e4c9-d24b-407e-b6ee-f284f79c2a18 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:25.032977 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9b28e4c9-d24b-407e-b6ee-f284f79c2a18 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:25.033392 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9b28e4c9-d24b-407e-b6ee-f284f79c2a18 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:25.099977 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-9b28e4c9-d24b-407e-b6ee-f284f79c2a18 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:25.107317 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9b28e4c9-d24b-407e-b6ee-f284f79c2a18 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1266 microversion: 2.1 time: 0.088784 Aug 17 07:32:25.107892 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 353/711] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:25 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:25.432941 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-f476d18e-050b-4e3e-9d0d-a98624d4e75d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:25.433552 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-f476d18e-050b-4e3e-9d0d-a98624d4e75d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:25.442432 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f476d18e-050b-4e3e-9d0d-a98624d4e75d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:25.442953 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f476d18e-050b-4e3e-9d0d-a98624d4e75d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:25.443393 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f476d18e-050b-4e3e-9d0d-a98624d4e75d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:25.444095 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f476d18e-050b-4e3e-9d0d-a98624d4e75d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:25.444557 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f476d18e-050b-4e3e-9d0d-a98624d4e75d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:25.444985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f476d18e-050b-4e3e-9d0d-a98624d4e75d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:25.577917 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-f476d18e-050b-4e3e-9d0d-a98624d4e75d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:25.586099 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-f476d18e-050b-4e3e-9d0d-a98624d4e75d tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325" status: 200 len: 1361 microversion: 2.1 time: 0.157294 Aug 17 07:32:25.586668 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 359/712] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:25 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:25.624867 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-4c681262-d644-4f04-9a76-d15763745a4b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:25.625481 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-4c681262-d644-4f04-9a76-d15763745a4b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:25.639158 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4c681262-d644-4f04-9a76-d15763745a4b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:25.639649 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4c681262-d644-4f04-9a76-d15763745a4b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:25.640142 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4c681262-d644-4f04-9a76-d15763745a4b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:25.640785 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4c681262-d644-4f04-9a76-d15763745a4b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:25.641237 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4c681262-d644-4f04-9a76-d15763745a4b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:25.641659 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4c681262-d644-4f04-9a76-d15763745a4b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:25.773813 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-4c681262-d644-4f04-9a76-d15763745a4b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:25.776143 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=100 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:25.782884 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-4c681262-d644-4f04-9a76-d15763745a4b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:25.784369 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-4c681262-d644-4f04-9a76-d15763745a4b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:25.785606 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-4c681262-d644-4f04-9a76-d15763745a4b tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1722 microversion: 2.20 time: 0.164737 Aug 17 07:32:25.786211 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 354/713] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:25 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:26.131610 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-f7684b22-db24-407c-a995-03b740369a8c tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:26.132655 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-f7684b22-db24-407c-a995-03b740369a8c tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:26.139050 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f7684b22-db24-407c-a995-03b740369a8c tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:26.140087 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f7684b22-db24-407c-a995-03b740369a8c tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:26.140962 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f7684b22-db24-407c-a995-03b740369a8c tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:26.141877 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f7684b22-db24-407c-a995-03b740369a8c tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:26.142584 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f7684b22-db24-407c-a995-03b740369a8c tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:26.143220 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f7684b22-db24-407c-a995-03b740369a8c tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:26.216459 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-f7684b22-db24-407c-a995-03b740369a8c tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:26.225284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-f7684b22-db24-407c-a995-03b740369a8c tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1274 microversion: 2.1 time: 0.101085 Aug 17 07:32:26.226244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 360/714] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:26 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1274 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:26.255539 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b045115d-1f53-475f-81e8-e773713bf792 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1820024349"}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:26.256198 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-b045115d-1f53-475f-81e8-e773713bf792 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:26.264231 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b045115d-1f53-475f-81e8-e773713bf792 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:26.264958 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b045115d-1f53-475f-81e8-e773713bf792 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:26.265495 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b045115d-1f53-475f-81e8-e773713bf792 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:26.266386 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b045115d-1f53-475f-81e8-e773713bf792 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:26.267001 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b045115d-1f53-475f-81e8-e773713bf792 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:26.267664 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b045115d-1f53-475f-81e8-e773713bf792 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:26.430199 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.network.security_group_api [None req-b045115d-1f53-475f-81e8-e773713bf792 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Removing security group f7068dd8-4afc-4dda-8a79-a14f2a356bec from port fb3fc6d2-2e3d-4fa5-979a-023f68ad390f Aug 17 07:32:26.606926 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ef94c589-8897-43a1-b1ae-fb9910a8387e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:26.608146 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-ef94c589-8897-43a1-b1ae-fb9910a8387e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:26.614801 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef94c589-8897-43a1-b1ae-fb9910a8387e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:26.615481 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef94c589-8897-43a1-b1ae-fb9910a8387e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:26.615918 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef94c589-8897-43a1-b1ae-fb9910a8387e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:26.616610 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef94c589-8897-43a1-b1ae-fb9910a8387e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:26.617312 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef94c589-8897-43a1-b1ae-fb9910a8387e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:26.617898 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef94c589-8897-43a1-b1ae-fb9910a8387e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:26.825242 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b045115d-1f53-475f-81e8-e773713bf792 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "POST /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/action" status: 202 len: 0 microversion: 2.1 time: 0.581700 Aug 17 07:32:26.831161 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 355/715] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 17 07:32:26 2022] POST /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:32:26.838815 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a02e6bc1-19aa-4f71-8001-74e34a8d1fe9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:26.839741 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-a02e6bc1-19aa-4f71-8001-74e34a8d1fe9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:26.839876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ef94c589-8897-43a1-b1ae-fb9910a8387e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:26.849346 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a02e6bc1-19aa-4f71-8001-74e34a8d1fe9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:26.850263 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a02e6bc1-19aa-4f71-8001-74e34a8d1fe9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:26.851938 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a02e6bc1-19aa-4f71-8001-74e34a8d1fe9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:26.853086 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a02e6bc1-19aa-4f71-8001-74e34a8d1fe9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:26.854803 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a02e6bc1-19aa-4f71-8001-74e34a8d1fe9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:26.855458 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a02e6bc1-19aa-4f71-8001-74e34a8d1fe9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:26.870330 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-ef94c589-8897-43a1-b1ae-fb9910a8387e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325" status: 200 len: 1547 microversion: 2.1 time: 0.254238 Aug 17 07:32:26.874496 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 361/716] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:26 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 => generated 1547 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:32:27.051803 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a02e6bc1-19aa-4f71-8001-74e34a8d1fe9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:27.068373 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a02e6bc1-19aa-4f71-8001-74e34a8d1fe9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:27.071287 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a02e6bc1-19aa-4f71-8001-74e34a8d1fe9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:27.073089 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a02e6bc1-19aa-4f71-8001-74e34a8d1fe9 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1722 microversion: 2.20 time: 0.239897 Aug 17 07:32:27.074548 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 356/717] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:26 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:27.080995 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-29fe65c9-5c0a-4b92-94c4-a00b8b4d399b tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:27.082343 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-29fe65c9-5c0a-4b92-94c4-a00b8b4d399b tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:27.090082 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-79973338-2319-490d-8465-c32d23469fef req-d341dabf-8363-4dfb-8444-1a886790f2ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a37385c-cdcc-4d52-89c4-241744d2d17d", "tag": "fb3fc6d2-2e3d-4fa5-979a-023f68ad390f"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:27.092804 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-29fe65c9-5c0a-4b92-94c4-a00b8b4d399b tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:27.093294 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-29fe65c9-5c0a-4b92-94c4-a00b8b4d399b tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:27.093724 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-29fe65c9-5c0a-4b92-94c4-a00b8b4d399b tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:27.101511 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-79973338-2319-490d-8465-c32d23469fef req-d341dabf-8363-4dfb-8444-1a886790f2ef service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:27.102099 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-79973338-2319-490d-8465-c32d23469fef req-d341dabf-8363-4dfb-8444-1a886790f2ef service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:27.102595 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-79973338-2319-490d-8465-c32d23469fef req-d341dabf-8363-4dfb-8444-1a886790f2ef service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:27.103441 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-29fe65c9-5c0a-4b92-94c4-a00b8b4d399b tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:27.104130 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-29fe65c9-5c0a-4b92-94c4-a00b8b4d399b tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:27.104985 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-29fe65c9-5c0a-4b92-94c4-a00b8b4d399b tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:27.114780 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-79973338-2319-490d-8465-c32d23469fef req-d341dabf-8363-4dfb-8444-1a886790f2ef service nova] Creating event network-changed:fb3fc6d2-2e3d-4fa5-979a-023f68ad390f for instance 4a37385c-cdcc-4d52-89c4-241744d2d17d on hv-cinder-85312 Aug 17 07:32:27.120271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-79973338-2319-490d-8465-c32d23469fef req-d341dabf-8363-4dfb-8444-1a886790f2ef service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.243303 Aug 17 07:32:27.121541 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 362/718] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:27.200786 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-29fe65c9-5c0a-4b92-94c4-a00b8b4d399b tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124845 Aug 17 07:32:27.201386 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 357/719] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 17 07:32:27 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:27.255703 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b5db6bf7-7de1-441a-9cf0-c3707bf83be1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:27.256406 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-b5db6bf7-7de1-441a-9cf0-c3707bf83be1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:27.262807 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b5db6bf7-7de1-441a-9cf0-c3707bf83be1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:27.263497 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b5db6bf7-7de1-441a-9cf0-c3707bf83be1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:27.264153 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b5db6bf7-7de1-441a-9cf0-c3707bf83be1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:27.264862 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b5db6bf7-7de1-441a-9cf0-c3707bf83be1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:27.265986 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b5db6bf7-7de1-441a-9cf0-c3707bf83be1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:27.266573 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b5db6bf7-7de1-441a-9cf0-c3707bf83be1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:27.394914 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b5db6bf7-7de1-441a-9cf0-c3707bf83be1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:27.410891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b5db6bf7-7de1-441a-9cf0-c3707bf83be1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1272 microversion: 2.1 time: 0.159909 Aug 17 07:32:27.422368 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 363/720] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:27 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1272 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:28.098364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-47ea20bc-5274-4f24-9961-79b449afea34 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:28.099816 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-47ea20bc-5274-4f24-9961-79b449afea34 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:28.106604 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-47ea20bc-5274-4f24-9961-79b449afea34 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:28.107523 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-47ea20bc-5274-4f24-9961-79b449afea34 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:28.108126 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-47ea20bc-5274-4f24-9961-79b449afea34 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:28.109025 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-47ea20bc-5274-4f24-9961-79b449afea34 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:28.109770 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-47ea20bc-5274-4f24-9961-79b449afea34 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:28.110403 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-47ea20bc-5274-4f24-9961-79b449afea34 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:28.433180 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-917be3a4-d2d4-4387-956b-5940008fbc42 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:28.434323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-917be3a4-d2d4-4387-956b-5940008fbc42 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:28.443201 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-917be3a4-d2d4-4387-956b-5940008fbc42 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:28.443856 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-917be3a4-d2d4-4387-956b-5940008fbc42 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:28.444637 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-917be3a4-d2d4-4387-956b-5940008fbc42 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:28.445459 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-917be3a4-d2d4-4387-956b-5940008fbc42 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:28.446328 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-917be3a4-d2d4-4387-956b-5940008fbc42 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:28.446931 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-917be3a4-d2d4-4387-956b-5940008fbc42 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:28.470295 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-47ea20bc-5274-4f24-9961-79b449afea34 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:28.484255 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-47ea20bc-5274-4f24-9961-79b449afea34 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:28.486062 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-47ea20bc-5274-4f24-9961-79b449afea34 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:28.487373 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-47ea20bc-5274-4f24-9961-79b449afea34 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1722 microversion: 2.20 time: 0.394495 Aug 17 07:32:28.487995 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 358/721] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:28 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1722 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:28.764349 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-917be3a4-d2d4-4387-956b-5940008fbc42 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:28.773079 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-917be3a4-d2d4-4387-956b-5940008fbc42 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1314 microversion: 2.1 time: 0.344223 Aug 17 07:32:28.786541 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 364/722] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:28 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:28.883337 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-608c07fb-707b-44fc-9cf0-ca1b8dea07b0 req-2314cf8e-e999-49e7-893c-71cbe9d622d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c70b0da9-1ec1-4631-bcde-ae8bb4177779", "tag": "a6ff95f4-295c-4b8c-b609-59e2ceb8041a"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:28.893009 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-608c07fb-707b-44fc-9cf0-ca1b8dea07b0 req-2314cf8e-e999-49e7-893c-71cbe9d622d6 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:28.893483 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-608c07fb-707b-44fc-9cf0-ca1b8dea07b0 req-2314cf8e-e999-49e7-893c-71cbe9d622d6 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:28.893914 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-608c07fb-707b-44fc-9cf0-ca1b8dea07b0 req-2314cf8e-e999-49e7-893c-71cbe9d622d6 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:28.904770 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-608c07fb-707b-44fc-9cf0-ca1b8dea07b0 req-2314cf8e-e999-49e7-893c-71cbe9d622d6 service nova] Creating event network-changed:a6ff95f4-295c-4b8c-b609-59e2ceb8041a for instance c70b0da9-1ec1-4631-bcde-ae8bb4177779 on hv-cinder-85312 Aug 17 07:32:28.909416 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-608c07fb-707b-44fc-9cf0-ca1b8dea07b0 req-2314cf8e-e999-49e7-893c-71cbe9d622d6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138087 Aug 17 07:32:28.910082 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 359/723] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:29.249384 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-738c5cf9-3eb1-4df2-b43c-8f958e78a6a4 req-f89409c2-3cd4-4e32-95a3-59772bb45e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325", "tag": "92cee9b4-b45b-4de3-a2a7-2bfe79574445"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:29.259699 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-738c5cf9-3eb1-4df2-b43c-8f958e78a6a4 req-f89409c2-3cd4-4e32-95a3-59772bb45e9a service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:29.260383 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-738c5cf9-3eb1-4df2-b43c-8f958e78a6a4 req-f89409c2-3cd4-4e32-95a3-59772bb45e9a service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:29.260967 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-738c5cf9-3eb1-4df2-b43c-8f958e78a6a4 req-f89409c2-3cd4-4e32-95a3-59772bb45e9a service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:29.273163 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-738c5cf9-3eb1-4df2-b43c-8f958e78a6a4 req-f89409c2-3cd4-4e32-95a3-59772bb45e9a service nova] Creating event network-changed:92cee9b4-b45b-4de3-a2a7-2bfe79574445 for instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 on hv-cinder-85312 Aug 17 07:32:29.278137 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-738c5cf9-3eb1-4df2-b43c-8f958e78a6a4 req-f89409c2-3cd4-4e32-95a3-59772bb45e9a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033391 Aug 17 07:32:29.279308 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 365/724] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:29.353927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ca31ae02-327e-4935-893d-bc7e65b67b42 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:29.355004 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ca31ae02-327e-4935-893d-bc7e65b67b42 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:29.364470 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ca31ae02-327e-4935-893d-bc7e65b67b42 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:29.364959 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ca31ae02-327e-4935-893d-bc7e65b67b42 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:29.365399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ca31ae02-327e-4935-893d-bc7e65b67b42 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:29.366141 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ca31ae02-327e-4935-893d-bc7e65b67b42 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:29.366592 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ca31ae02-327e-4935-893d-bc7e65b67b42 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:29.367281 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ca31ae02-327e-4935-893d-bc7e65b67b42 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:29.467347 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.objects.instance [None req-ca31ae02-327e-4935-893d-bc7e65b67b42 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lazy-loading 'services' on Instance uuid 4a37385c-cdcc-4d52-89c4-241744d2d17d {{(pid=120834) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:32:29.512298 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-96e2fb4a-b232-462b-a27c-a9b9889bae46 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:29.513787 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-96e2fb4a-b232-462b-a27c-a9b9889bae46 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:29.521551 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-96e2fb4a-b232-462b-a27c-a9b9889bae46 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:29.522422 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-96e2fb4a-b232-462b-a27c-a9b9889bae46 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:29.523117 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-96e2fb4a-b232-462b-a27c-a9b9889bae46 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:29.523966 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-96e2fb4a-b232-462b-a27c-a9b9889bae46 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:29.524559 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-96e2fb4a-b232-462b-a27c-a9b9889bae46 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:29.524990 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-96e2fb4a-b232-462b-a27c-a9b9889bae46 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:29.578666 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ca31ae02-327e-4935-893d-bc7e65b67b42 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/os-volume_attachments/9c4cbc02-fc75-4640-b404-ae2eba0682e3" status: 202 len: 0 microversion: 2.1 time: 0.229072 Aug 17 07:32:29.580026 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 360/725] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 17 07:32:29 2022] DELETE /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/os-volume_attachments/9c4cbc02-fc75-4640-b404-ae2eba0682e3 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:32:29.590405 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-74978694-5276-4b4c-92f4-633e8e213407 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:29.593648 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-74978694-5276-4b4c-92f4-633e8e213407 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:29.603904 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-74978694-5276-4b4c-92f4-633e8e213407 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:29.604936 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-74978694-5276-4b4c-92f4-633e8e213407 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:29.605730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-74978694-5276-4b4c-92f4-633e8e213407 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:29.607014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-74978694-5276-4b4c-92f4-633e8e213407 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:29.608226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-74978694-5276-4b4c-92f4-633e8e213407 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:29.609043 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-74978694-5276-4b4c-92f4-633e8e213407 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:29.646978 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-74978694-5276-4b4c-92f4-633e8e213407 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061813 Aug 17 07:32:29.648262 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 361/726] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:32:29 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:29.678743 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-96e2fb4a-b232-462b-a27c-a9b9889bae46 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:29.687600 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-96e2fb4a-b232-462b-a27c-a9b9889bae46 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:29.689343 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-96e2fb4a-b232-462b-a27c-a9b9889bae46 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:29.690722 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-96e2fb4a-b232-462b-a27c-a9b9889bae46 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1743 microversion: 2.20 time: 0.182780 Aug 17 07:32:29.691792 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 366/727] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:29 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1743 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:32:29.794472 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-4c218f3f-2a23-4e79-a0cd-97f26dc60894 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:29.795080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-4c218f3f-2a23-4e79-a0cd-97f26dc60894 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:29.801218 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4c218f3f-2a23-4e79-a0cd-97f26dc60894 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:29.801706 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4c218f3f-2a23-4e79-a0cd-97f26dc60894 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:29.802164 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4c218f3f-2a23-4e79-a0cd-97f26dc60894 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:29.802864 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4c218f3f-2a23-4e79-a0cd-97f26dc60894 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:29.803513 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4c218f3f-2a23-4e79-a0cd-97f26dc60894 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:29.803885 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4c218f3f-2a23-4e79-a0cd-97f26dc60894 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:29.947603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-4c218f3f-2a23-4e79-a0cd-97f26dc60894 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:29.955192 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-4c218f3f-2a23-4e79-a0cd-97f26dc60894 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1314 microversion: 2.1 time: 0.165189 Aug 17 07:32:29.955829 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 362/728] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:29 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:30.660697 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-6adf13b4-45cc-4cfd-9c3d-9933fd6b9e7a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:30.662860 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-6adf13b4-45cc-4cfd-9c3d-9933fd6b9e7a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:30.669250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6adf13b4-45cc-4cfd-9c3d-9933fd6b9e7a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:30.669724 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6adf13b4-45cc-4cfd-9c3d-9933fd6b9e7a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:30.670190 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6adf13b4-45cc-4cfd-9c3d-9933fd6b9e7a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:30.670873 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6adf13b4-45cc-4cfd-9c3d-9933fd6b9e7a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:30.671360 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6adf13b4-45cc-4cfd-9c3d-9933fd6b9e7a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:30.671782 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6adf13b4-45cc-4cfd-9c3d-9933fd6b9e7a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:30.700177 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-6adf13b4-45cc-4cfd-9c3d-9933fd6b9e7a tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043905 Aug 17 07:32:30.700730 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 367/729] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:32:30 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:30.712510 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-e0917d0f-9a9c-4d91-89f0-8706e222adea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:30.713051 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-e0917d0f-9a9c-4d91-89f0-8706e222adea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:30.719437 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e0917d0f-9a9c-4d91-89f0-8706e222adea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:30.719914 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e0917d0f-9a9c-4d91-89f0-8706e222adea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:30.720346 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e0917d0f-9a9c-4d91-89f0-8706e222adea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:30.721030 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e0917d0f-9a9c-4d91-89f0-8706e222adea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:30.721478 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e0917d0f-9a9c-4d91-89f0-8706e222adea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:30.721910 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e0917d0f-9a9c-4d91-89f0-8706e222adea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:30.859162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-e0917d0f-9a9c-4d91-89f0-8706e222adea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:30.868628 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-e0917d0f-9a9c-4d91-89f0-8706e222adea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:30.870171 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-e0917d0f-9a9c-4d91-89f0-8706e222adea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:30.871326 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-e0917d0f-9a9c-4d91-89f0-8706e222adea tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1743 microversion: 2.20 time: 0.162719 Aug 17 07:32:30.871939 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 363/730] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:30 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:30.976960 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b048352c-41ce-49c0-a9b6-8c01072ea46b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:30.977478 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-b048352c-41ce-49c0-a9b6-8c01072ea46b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:30.983344 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b048352c-41ce-49c0-a9b6-8c01072ea46b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:30.983844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b048352c-41ce-49c0-a9b6-8c01072ea46b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:30.984278 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b048352c-41ce-49c0-a9b6-8c01072ea46b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:30.984952 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b048352c-41ce-49c0-a9b6-8c01072ea46b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:30.985400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b048352c-41ce-49c0-a9b6-8c01072ea46b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:30.985818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b048352c-41ce-49c0-a9b6-8c01072ea46b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:31.119005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-b048352c-41ce-49c0-a9b6-8c01072ea46b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:31.126599 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b048352c-41ce-49c0-a9b6-8c01072ea46b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1314 microversion: 2.1 time: 0.153556 Aug 17 07:32:31.127180 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 368/731] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:30 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:31.295248 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-b0e80a92-008e-4ba1-95aa-ea1e433ae11a req-70dcfe78-1fee-4aa3-bfe2-20389f74030d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a37385c-cdcc-4d52-89c4-241744d2d17d", "tag": "fb3fc6d2-2e3d-4fa5-979a-023f68ad390f"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:31.305253 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-b0e80a92-008e-4ba1-95aa-ea1e433ae11a req-70dcfe78-1fee-4aa3-bfe2-20389f74030d service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:31.305884 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-b0e80a92-008e-4ba1-95aa-ea1e433ae11a req-70dcfe78-1fee-4aa3-bfe2-20389f74030d service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:31.306357 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-b0e80a92-008e-4ba1-95aa-ea1e433ae11a req-70dcfe78-1fee-4aa3-bfe2-20389f74030d service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:31.317923 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-b0e80a92-008e-4ba1-95aa-ea1e433ae11a req-70dcfe78-1fee-4aa3-bfe2-20389f74030d service nova] Creating event network-changed:fb3fc6d2-2e3d-4fa5-979a-023f68ad390f for instance 4a37385c-cdcc-4d52-89c4-241744d2d17d on hv-cinder-85312 Aug 17 07:32:31.322880 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-b0e80a92-008e-4ba1-95aa-ea1e433ae11a req-70dcfe78-1fee-4aa3-bfe2-20389f74030d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031445 Aug 17 07:32:31.323714 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 364/732] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:31.713809 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9ab87731-63d3-4c41-890d-eb972023a113 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:31.715958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-9ab87731-63d3-4c41-890d-eb972023a113 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:31.723454 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9ab87731-63d3-4c41-890d-eb972023a113 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:31.724239 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9ab87731-63d3-4c41-890d-eb972023a113 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:31.724878 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9ab87731-63d3-4c41-890d-eb972023a113 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:31.725662 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9ab87731-63d3-4c41-890d-eb972023a113 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:31.726249 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9ab87731-63d3-4c41-890d-eb972023a113 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:31.726863 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9ab87731-63d3-4c41-890d-eb972023a113 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:31.762088 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-9ab87731-63d3-4c41-890d-eb972023a113 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052902 Aug 17 07:32:31.763979 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 369/733] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:32:31 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 07:32:31.775329 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0860c4ae-1ebb-4a2b-ad90-b6f70beb3c66 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:31.775904 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0860c4ae-1ebb-4a2b-ad90-b6f70beb3c66 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:31.782429 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0860c4ae-1ebb-4a2b-ad90-b6f70beb3c66 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:31.782910 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0860c4ae-1ebb-4a2b-ad90-b6f70beb3c66 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:31.783583 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0860c4ae-1ebb-4a2b-ad90-b6f70beb3c66 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:31.784530 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0860c4ae-1ebb-4a2b-ad90-b6f70beb3c66 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:31.785209 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0860c4ae-1ebb-4a2b-ad90-b6f70beb3c66 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:31.785786 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0860c4ae-1ebb-4a2b-ad90-b6f70beb3c66 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:31.892130 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-0860c4ae-1ebb-4a2b-ad90-b6f70beb3c66 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] HTTP exception thrown: Instance 4a37385c-cdcc-4d52-89c4-241744d2d17d is not attached to volume 9c4cbc02-fc75-4640-b404-ae2eba0682e3 Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0860c4ae-1ebb-4a2b-ad90-b6f70beb3c66 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Request method failure captured: Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: DELETE /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/os-volume_attachments/9c4cbc02-fc75-4640-b404-ae2eba0682e3 HTTP/1.1 Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JjRcT_7vpPEuVTE5hKaYe8I9zwaCfqCJpXfFC8hN_x-wuFk4rN7Cx3iqt2WO9pCWoyrAZUiXQc60IcQarQlbArd4X2H_MILKRvGLR19lksoh30SEQRmomy0VZ3L0tt9UBJrF8bKCdCClKYMKea6KggtnJBM15k3g9hDsM8r1tnPuhU Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 5192a78d86bc40ae96a3cbb283992463 Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-TestMinimumBasicScenario-439896266 Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:32:31.895254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:32:31.896745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5192a78d86bc40ae96a3cbb283992463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5192a78d86bc40ae96a3cbb283992463"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5192a78d86bc40ae96a3cbb283992463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5192a78d86bc40ae96a3cbb283992463"}]}] Aug 17 07:32:31.896745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-TestMinimumBasicScenario-439896266 Aug 17 07:32:31.896745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 5192a78d86bc40ae96a3cbb283992463 Aug 17 07:32:31.896745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-TestMinimumBasicScenario-439896266 Aug 17 07:32:31.896745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-TestMinimumBasicScenario-439896266-project Aug 17 07:32:31.896745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:32:31.896745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:32:31.896745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: 2aa5f23fe0ea4030b3858f3e5ccde8c1 Aug 17 07:32:31.896745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-TestMinimumBasicScenario-439896266-project Aug 17 07:32:31.896745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:32:31.896745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance 4a37385c-cdcc-4d52-89c4-241744d2d17d is not attached to volume 9c4cbc02-fc75-4640-b404-ae2eba0682e3 Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'server_id': '4a37385c-cdcc-4d52-89c4-241744d2d17d', 'id': '9c4cbc02-fc75-4640-b404-ae2eba0682e3'} Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9c4cbc02-fc75-4640-b404-ae2eba0682e3. Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:32:31.897598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:32:31.898870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:32:31.898870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 17 07:32:31.898870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 17 07:32:31.898870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a37385c-cdcc-4d52-89c4-241744d2d17d is not attached to volume 9c4cbc02-fc75-4640-b404-ae2eba0682e3 Aug 17 07:32:31.898870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:32:31.898870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:32:31.898870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:32:31.898870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:32:31.898870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:32:31.898870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:32:31.898870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:32:31.898870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:32:31.898870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a37385c-cdcc-4d52-89c4-241744d2d17d is not attached to volume 9c4cbc02-fc75-4640-b404-ae2eba0682e3 Aug 17 07:32:31.898870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:32:31.901236 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d907da32-6eab-4337-9dcd-e26b4b4dc776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:31.901852 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0860c4ae-1ebb-4a2b-ad90-b6f70beb3c66 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Returning 404 to user: Instance 4a37385c-cdcc-4d52-89c4-241744d2d17d is not attached to volume 9c4cbc02-fc75-4640-b404-ae2eba0682e3 {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:32:31.902084 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d907da32-6eab-4337-9dcd-e26b4b4dc776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:31.903052 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0860c4ae-1ebb-4a2b-ad90-b6f70beb3c66 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/os-volume_attachments/9c4cbc02-fc75-4640-b404-ae2eba0682e3" status: 404 len: 154 microversion: 2.1 time: 0.132810 Aug 17 07:32:31.904116 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 365/734] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 17 07:32:31 2022] DELETE /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d/os-volume_attachments/9c4cbc02-fc75-4640-b404-ae2eba0682e3 => generated 154 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:32:31.910616 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d907da32-6eab-4337-9dcd-e26b4b4dc776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:31.911365 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d907da32-6eab-4337-9dcd-e26b4b4dc776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:31.913011 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d907da32-6eab-4337-9dcd-e26b4b4dc776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:31.914989 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d907da32-6eab-4337-9dcd-e26b4b4dc776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:31.915566 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d907da32-6eab-4337-9dcd-e26b4b4dc776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:31.916102 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d907da32-6eab-4337-9dcd-e26b4b4dc776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:32.146893 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-557d9d71-1d49-45dd-aa0f-f8de11f988ff tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:32.147502 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-557d9d71-1d49-45dd-aa0f-f8de11f988ff tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:32.165739 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-557d9d71-1d49-45dd-aa0f-f8de11f988ff tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:32.166709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-557d9d71-1d49-45dd-aa0f-f8de11f988ff tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:32.167324 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-557d9d71-1d49-45dd-aa0f-f8de11f988ff tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:32.169570 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-557d9d71-1d49-45dd-aa0f-f8de11f988ff tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:32.172620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-557d9d71-1d49-45dd-aa0f-f8de11f988ff tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:32.173420 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-557d9d71-1d49-45dd-aa0f-f8de11f988ff tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:32.210924 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d907da32-6eab-4337-9dcd-e26b4b4dc776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:32.224167 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d907da32-6eab-4337-9dcd-e26b4b4dc776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:32.225991 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d907da32-6eab-4337-9dcd-e26b4b4dc776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:32.230254 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d907da32-6eab-4337-9dcd-e26b4b4dc776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1738 microversion: 2.20 time: 0.338950 Aug 17 07:32:32.234379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 370/735] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:31 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1738 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:32.403232 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-557d9d71-1d49-45dd-aa0f-f8de11f988ff tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:32.418889 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-557d9d71-1d49-45dd-aa0f-f8de11f988ff tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1314 microversion: 2.1 time: 0.275517 Aug 17 07:32:32.419803 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 366/736] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:32 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:32:33.106337 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-59967da3-6930-4a22-92fb-932573e786f8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:33.108335 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-59967da3-6930-4a22-92fb-932573e786f8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:33.114802 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-59967da3-6930-4a22-92fb-932573e786f8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:33.115581 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-59967da3-6930-4a22-92fb-932573e786f8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:33.116240 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-59967da3-6930-4a22-92fb-932573e786f8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:33.117445 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-59967da3-6930-4a22-92fb-932573e786f8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:33.118656 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-59967da3-6930-4a22-92fb-932573e786f8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:33.119296 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-59967da3-6930-4a22-92fb-932573e786f8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:33.149655 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-59967da3-6930-4a22-92fb-932573e786f8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Going to try to terminate instance {{(pid=120835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:32:33.152313 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=100 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:33.257697 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-8890655b-ffb6-4c36-ad42-2cae81b09935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:33.259018 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-59967da3-6930-4a22-92fb-932573e786f8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 204 len: 0 microversion: 2.1 time: 0.156186 Aug 17 07:32:33.259182 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-8890655b-ffb6-4c36-ad42-2cae81b09935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:33.261167 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 371/737] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:32:33 2022] DELETE /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:32:33.271308 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-99444cb3-9030-485d-8090-8b7ad88a3133 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:33.272501 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-99444cb3-9030-485d-8090-8b7ad88a3133 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:33.272904 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8890655b-ffb6-4c36-ad42-2cae81b09935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:33.273396 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8890655b-ffb6-4c36-ad42-2cae81b09935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:33.273830 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8890655b-ffb6-4c36-ad42-2cae81b09935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:33.274583 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8890655b-ffb6-4c36-ad42-2cae81b09935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:33.275038 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8890655b-ffb6-4c36-ad42-2cae81b09935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:33.275459 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8890655b-ffb6-4c36-ad42-2cae81b09935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:33.281346 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-99444cb3-9030-485d-8090-8b7ad88a3133 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:33.282358 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-99444cb3-9030-485d-8090-8b7ad88a3133 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:33.283016 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-99444cb3-9030-485d-8090-8b7ad88a3133 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:33.284092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-99444cb3-9030-485d-8090-8b7ad88a3133 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:33.285630 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-99444cb3-9030-485d-8090-8b7ad88a3133 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:33.286458 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-99444cb3-9030-485d-8090-8b7ad88a3133 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:33.525109 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-8890655b-ffb6-4c36-ad42-2cae81b09935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:33.539469 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-8890655b-ffb6-4c36-ad42-2cae81b09935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:33.541994 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-8890655b-ffb6-4c36-ad42-2cae81b09935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:33.545732 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-99444cb3-9030-485d-8090-8b7ad88a3133 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:33.553517 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-99444cb3-9030-485d-8090-8b7ad88a3133 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1553 microversion: 2.1 time: 0.287857 Aug 17 07:32:33.554113 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 372/738] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:33 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1553 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:33.561891 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-8890655b-ffb6-4c36-ad42-2cae81b09935 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1738 microversion: 2.20 time: 0.308956 Aug 17 07:32:33.562547 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 367/739] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:33 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:32:33.567427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e34aa841-b481-45c3-9d27-4436e1ba90c1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:33.568201 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e34aa841-b481-45c3-9d27-4436e1ba90c1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:33.574362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e34aa841-b481-45c3-9d27-4436e1ba90c1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:33.574861 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e34aa841-b481-45c3-9d27-4436e1ba90c1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:33.575290 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e34aa841-b481-45c3-9d27-4436e1ba90c1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:33.575968 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e34aa841-b481-45c3-9d27-4436e1ba90c1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:33.576414 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e34aa841-b481-45c3-9d27-4436e1ba90c1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:33.576907 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e34aa841-b481-45c3-9d27-4436e1ba90c1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:33.716540 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-e34aa841-b481-45c3-9d27-4436e1ba90c1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:33.724495 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e34aa841-b481-45c3-9d27-4436e1ba90c1 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1314 microversion: 2.1 time: 0.160701 Aug 17 07:32:33.734658 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 373/740] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:33 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:34.414667 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-cfe16c2a-d26e-4321-8fc8-872c29680177 req-020ff779-70cf-460b-8359-27984f8729be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c084749b-e2a5-48ae-a864-1ef8c56b5934", "name": "network-vif-plugged", "status": "completed", "tag": "9ba8e1e3-4b4b-4036-bc27-7a1fb46ead6d"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:34.422805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:34.431883 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-cfe16c2a-d26e-4321-8fc8-872c29680177 req-020ff779-70cf-460b-8359-27984f8729be service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:34.432680 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-cfe16c2a-d26e-4321-8fc8-872c29680177 req-020ff779-70cf-460b-8359-27984f8729be service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:34.434298 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-cfe16c2a-d26e-4321-8fc8-872c29680177 req-020ff779-70cf-460b-8359-27984f8729be service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:34.453334 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-cfe16c2a-d26e-4321-8fc8-872c29680177 req-020ff779-70cf-460b-8359-27984f8729be service nova] Creating event network-vif-plugged:9ba8e1e3-4b4b-4036-bc27-7a1fb46ead6d for instance c084749b-e2a5-48ae-a864-1ef8c56b5934 on hv-cinder-85312 Aug 17 07:32:34.460158 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-cfe16c2a-d26e-4321-8fc8-872c29680177 req-020ff779-70cf-460b-8359-27984f8729be service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050316 Aug 17 07:32:34.461763 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 368/741] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:34.579401 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-583043f4-40b7-459f-8b95-033c318a39a8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:34.580097 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-583043f4-40b7-459f-8b95-033c318a39a8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:34.582109 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=4 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:34.582762 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=12 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:34.585801 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-5e7f05c3-8727-4b43-983b-70ea00eca9a3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:34.586526 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-5e7f05c3-8727-4b43-983b-70ea00eca9a3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:34.589811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-583043f4-40b7-459f-8b95-033c318a39a8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:34.590349 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-583043f4-40b7-459f-8b95-033c318a39a8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:34.590779 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-583043f4-40b7-459f-8b95-033c318a39a8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:34.591473 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-583043f4-40b7-459f-8b95-033c318a39a8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:34.591922 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-583043f4-40b7-459f-8b95-033c318a39a8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:34.592343 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-583043f4-40b7-459f-8b95-033c318a39a8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:34.593799 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5e7f05c3-8727-4b43-983b-70ea00eca9a3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:34.594709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5e7f05c3-8727-4b43-983b-70ea00eca9a3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:34.595217 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5e7f05c3-8727-4b43-983b-70ea00eca9a3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:34.596039 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5e7f05c3-8727-4b43-983b-70ea00eca9a3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:34.596552 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5e7f05c3-8727-4b43-983b-70ea00eca9a3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:34.599142 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5e7f05c3-8727-4b43-983b-70ea00eca9a3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:34.856537 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-5e7f05c3-8727-4b43-983b-70ea00eca9a3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:34.861656 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-583043f4-40b7-459f-8b95-033c318a39a8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:34.867730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-5e7f05c3-8727-4b43-983b-70ea00eca9a3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:34.869320 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-5e7f05c3-8727-4b43-983b-70ea00eca9a3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:34.870757 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-5e7f05c3-8727-4b43-983b-70ea00eca9a3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1738 microversion: 2.20 time: 0.289829 Aug 17 07:32:34.871624 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 369/742] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:34 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1738 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:34.876175 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-d4a7b144-b07c-42e7-9ed9-b6ff63e57c91 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:34.876778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-d4a7b144-b07c-42e7-9ed9-b6ff63e57c91 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:34.880788 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-583043f4-40b7-459f-8b95-033c318a39a8 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1553 microversion: 2.1 time: 0.295619 Aug 17 07:32:34.886036 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 374/743] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:34 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1553 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:34.888380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d4a7b144-b07c-42e7-9ed9-b6ff63e57c91 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:34.888954 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d4a7b144-b07c-42e7-9ed9-b6ff63e57c91 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:34.889633 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d4a7b144-b07c-42e7-9ed9-b6ff63e57c91 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:34.890379 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d4a7b144-b07c-42e7-9ed9-b6ff63e57c91 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:34.890835 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d4a7b144-b07c-42e7-9ed9-b6ff63e57c91 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:34.891264 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d4a7b144-b07c-42e7-9ed9-b6ff63e57c91 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:35.044917 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-d4a7b144-b07c-42e7-9ed9-b6ff63e57c91 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:35.053565 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-d4a7b144-b07c-42e7-9ed9-b6ff63e57c91 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1314 microversion: 2.1 time: 0.180819 Aug 17 07:32:35.054164 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 370/744] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:34 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:35.895231 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-1e9d0d2b-e07f-4703-be83-f62b9e50fea3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:35.896523 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-1e9d0d2b-e07f-4703-be83-f62b9e50fea3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:35.903698 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1e9d0d2b-e07f-4703-be83-f62b9e50fea3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:35.904579 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1e9d0d2b-e07f-4703-be83-f62b9e50fea3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:35.905484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1e9d0d2b-e07f-4703-be83-f62b9e50fea3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:35.905791 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-cff83799-c733-46ba-8667-3cc16a4f4f95 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:35.907530 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1e9d0d2b-e07f-4703-be83-f62b9e50fea3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:35.908223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1e9d0d2b-e07f-4703-be83-f62b9e50fea3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:35.908863 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1e9d0d2b-e07f-4703-be83-f62b9e50fea3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:35.911911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-cff83799-c733-46ba-8667-3cc16a4f4f95 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:35.936883 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cff83799-c733-46ba-8667-3cc16a4f4f95 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:35.938322 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cff83799-c733-46ba-8667-3cc16a4f4f95 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:35.938876 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cff83799-c733-46ba-8667-3cc16a4f4f95 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:35.939703 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cff83799-c733-46ba-8667-3cc16a4f4f95 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:35.941571 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cff83799-c733-46ba-8667-3cc16a4f4f95 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:35.943350 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cff83799-c733-46ba-8667-3cc16a4f4f95 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:36.054578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-cff83799-c733-46ba-8667-3cc16a4f4f95 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa5f23fe0ea4030b3858f3e5ccde8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5192a78d86bc40ae96a3cbb283992463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:36.066448 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-cff83799-c733-46ba-8667-3cc16a4f4f95 tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 200 len: 1511 microversion: 2.1 time: 0.163385 Aug 17 07:32:36.084813 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 371/745] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:35 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:36.089814 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-fed05c69-bd36-4af7-91c0-d6c402bd5687 req-a6687f36-c7d1-4072-83cf-c320b09e1cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a37385c-cdcc-4d52-89c4-241744d2d17d", "name": "network-vif-deleted", "tag": "fb3fc6d2-2e3d-4fa5-979a-023f68ad390f"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:36.105105 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-fed05c69-bd36-4af7-91c0-d6c402bd5687 req-a6687f36-c7d1-4072-83cf-c320b09e1cd4 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:36.105787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-fed05c69-bd36-4af7-91c0-d6c402bd5687 req-a6687f36-c7d1-4072-83cf-c320b09e1cd4 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:36.106238 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-fed05c69-bd36-4af7-91c0-d6c402bd5687 req-a6687f36-c7d1-4072-83cf-c320b09e1cd4 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:36.119772 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-fed05c69-bd36-4af7-91c0-d6c402bd5687 req-a6687f36-c7d1-4072-83cf-c320b09e1cd4 service nova] Creating event network-vif-deleted:fb3fc6d2-2e3d-4fa5-979a-023f68ad390f for instance 4a37385c-cdcc-4d52-89c4-241744d2d17d on hv-cinder-85312 Aug 17 07:32:36.125627 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-fed05c69-bd36-4af7-91c0-d6c402bd5687 req-a6687f36-c7d1-4072-83cf-c320b09e1cd4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056909 Aug 17 07:32:36.126547 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 372/746] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:36.132886 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-56a56a91-4d1f-46c6-89b5-637a2181f768 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:36.133591 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-56a56a91-4d1f-46c6-89b5-637a2181f768 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:36.141754 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-56a56a91-4d1f-46c6-89b5-637a2181f768 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:36.142276 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-56a56a91-4d1f-46c6-89b5-637a2181f768 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:36.142706 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-56a56a91-4d1f-46c6-89b5-637a2181f768 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:36.143407 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-56a56a91-4d1f-46c6-89b5-637a2181f768 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:36.145089 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-56a56a91-4d1f-46c6-89b5-637a2181f768 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:36.145221 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-56a56a91-4d1f-46c6-89b5-637a2181f768 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:36.189875 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-1e9d0d2b-e07f-4703-be83-f62b9e50fea3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:36.202766 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-1e9d0d2b-e07f-4703-be83-f62b9e50fea3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:36.206812 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-1e9d0d2b-e07f-4703-be83-f62b9e50fea3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:36.208579 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-1e9d0d2b-e07f-4703-be83-f62b9e50fea3 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1738 microversion: 2.20 time: 0.317426 Aug 17 07:32:36.211015 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 375/747] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:35 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1738 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:36.317860 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-56a56a91-4d1f-46c6-89b5-637a2181f768 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:36.327954 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-56a56a91-4d1f-46c6-89b5-637a2181f768 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1314 microversion: 2.1 time: 0.200311 Aug 17 07:32:36.328894 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 373/748] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:36 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:36.571258 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-2df659c8-438c-4238-b837-e1986e7d1f0b req-b455c27b-6d37-48a0-9441-3cebb88e7cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70b0da9-1ec1-4631-bcde-ae8bb4177779", "name": "network-vif-plugged", "status": "completed", "tag": "a6ff95f4-295c-4b8c-b609-59e2ceb8041a"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:36.584371 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-2df659c8-438c-4238-b837-e1986e7d1f0b req-b455c27b-6d37-48a0-9441-3cebb88e7cd7 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:36.584884 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-2df659c8-438c-4238-b837-e1986e7d1f0b req-b455c27b-6d37-48a0-9441-3cebb88e7cd7 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:36.585333 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-2df659c8-438c-4238-b837-e1986e7d1f0b req-b455c27b-6d37-48a0-9441-3cebb88e7cd7 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:36.600727 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-2df659c8-438c-4238-b837-e1986e7d1f0b req-b455c27b-6d37-48a0-9441-3cebb88e7cd7 service nova] Creating event network-vif-plugged:a6ff95f4-295c-4b8c-b609-59e2ceb8041a for instance c70b0da9-1ec1-4631-bcde-ae8bb4177779 on hv-cinder-85312 Aug 17 07:32:36.605837 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-2df659c8-438c-4238-b837-e1986e7d1f0b req-b455c27b-6d37-48a0-9441-3cebb88e7cd7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119462 Aug 17 07:32:36.606683 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 376/749] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:32:37.091746 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1179985e-2d7d-48a9-ad1e-d146448a38af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:37.093434 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-1179985e-2d7d-48a9-ad1e-d146448a38af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] [instance: 4a37385c-cdcc-4d52-89c4-241744d2d17d] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:37.100154 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1179985e-2d7d-48a9-ad1e-d146448a38af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:37.100751 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1179985e-2d7d-48a9-ad1e-d146448a38af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:37.101254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1179985e-2d7d-48a9-ad1e-d146448a38af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:37.102032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1179985e-2d7d-48a9-ad1e-d146448a38af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:37.102874 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1179985e-2d7d-48a9-ad1e-d146448a38af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:37.103515 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1179985e-2d7d-48a9-ad1e-d146448a38af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:37.106420 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:37.119710 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-1179985e-2d7d-48a9-ad1e-d146448a38af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] HTTP exception thrown: Instance 4a37385c-cdcc-4d52-89c4-241744d2d17d could not be found. Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1179985e-2d7d-48a9-ad1e-d146448a38af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Request method failure captured: Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d HTTP/1.1 Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JjRcT_7vpPEuVTE5hKaYe8I9zwaCfqCJpXfFC8hN_x-wuFk4rN7Cx3iqt2WO9pCWoyrAZUiXQc60IcQarQlbArd4X2H_MILKRvGLR19lksoh30SEQRmomy0VZ3L0tt9UBJrF8bKCdCClKYMKea6KggtnJBM15k3g9hDsM8r1tnPuhU Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 5192a78d86bc40ae96a3cbb283992463 Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-TestMinimumBasicScenario-439896266 Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:32:37.121430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:32:37.123194 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5192a78d86bc40ae96a3cbb283992463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5192a78d86bc40ae96a3cbb283992463"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5192a78d86bc40ae96a3cbb283992463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5192a78d86bc40ae96a3cbb283992463"}]}] Aug 17 07:32:37.123194 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-TestMinimumBasicScenario-439896266 Aug 17 07:32:37.123194 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 5192a78d86bc40ae96a3cbb283992463 Aug 17 07:32:37.123194 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-TestMinimumBasicScenario-439896266 Aug 17 07:32:37.123194 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-TestMinimumBasicScenario-439896266-project Aug 17 07:32:37.123194 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:32:37.123194 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:32:37.123194 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: 2aa5f23fe0ea4030b3858f3e5ccde8c1 Aug 17 07:32:37.123194 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-TestMinimumBasicScenario-439896266-project Aug 17 07:32:37.123194 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:32:37.123194 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance 4a37385c-cdcc-4d52-89c4-241744d2d17d could not be found. Aug 17 07:32:37.123194 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': '4a37385c-cdcc-4d52-89c4-241744d2d17d'} Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a37385c-cdcc-4d52-89c4-241744d2d17d could not be found. Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:32:37.124115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:32:37.126359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:32:37.126359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:32:37.126359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:32:37.126359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:32:37.126359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:32:37.126359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:32:37.126359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:32:37.126359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a37385c-cdcc-4d52-89c4-241744d2d17d could not be found. Aug 17 07:32:37.126359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:32:37.126359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:32:37.126359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:32:37.126359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:32:37.126359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:32:37.126359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:32:37.126359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:32:37.126359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:32:37.126359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a37385c-cdcc-4d52-89c4-241744d2d17d could not be found. Aug 17 07:32:37.126359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:32:37.128102 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1179985e-2d7d-48a9-ad1e-d146448a38af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Returning 404 to user: Instance 4a37385c-cdcc-4d52-89c4-241744d2d17d could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:32:37.128102 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-1179985e-2d7d-48a9-ad1e-d146448a38af tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d" status: 404 len: 111 microversion: 2.1 time: 0.036220 Aug 17 07:32:37.129659 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 374/750] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:37 2022] GET /compute/v2.1/servers/4a37385c-cdcc-4d52-89c4-241744d2d17d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:32:37.135652 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-0e90933a-7945-48c1-97b3-7f6767232cde tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] Calling method '.version_select at 0x7f30ac1ca310>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:37.161729 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-0e90933a-7945-48c1-97b3-7f6767232cde tempest-TestMinimumBasicScenario-439896266 tempest-TestMinimumBasicScenario-439896266-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-83067864" status: 202 len: 0 microversion: 2.1 time: 0.030750 Aug 17 07:32:37.162393 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 377/751] 10.222.0.45 () {58 vars in 1266 bytes} [Wed Aug 17 07:32:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-83067864 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:32:37.243527 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-8d8b37f0-9c74-465c-bd8a-da21d816a776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:37.244417 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-8d8b37f0-9c74-465c-bd8a-da21d816a776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:37.251210 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8d8b37f0-9c74-465c-bd8a-da21d816a776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:37.252672 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8d8b37f0-9c74-465c-bd8a-da21d816a776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:37.254046 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8d8b37f0-9c74-465c-bd8a-da21d816a776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:37.255543 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8d8b37f0-9c74-465c-bd8a-da21d816a776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:37.256150 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8d8b37f0-9c74-465c-bd8a-da21d816a776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:37.264669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8d8b37f0-9c74-465c-bd8a-da21d816a776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:37.349466 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2a460455-29dc-45fb-8b4b-f9562a35d1f6 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:37.350890 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-2a460455-29dc-45fb-8b4b-f9562a35d1f6 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:37.356334 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:37.373127 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a460455-29dc-45fb-8b4b-f9562a35d1f6 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:37.373645 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a460455-29dc-45fb-8b4b-f9562a35d1f6 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:37.374106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a460455-29dc-45fb-8b4b-f9562a35d1f6 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:37.375108 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a460455-29dc-45fb-8b4b-f9562a35d1f6 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:37.375538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a460455-29dc-45fb-8b4b-f9562a35d1f6 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:37.375972 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a460455-29dc-45fb-8b4b-f9562a35d1f6 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:37.523429 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-8d8b37f0-9c74-465c-bd8a-da21d816a776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:37.537545 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-8d8b37f0-9c74-465c-bd8a-da21d816a776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:37.539156 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-8d8b37f0-9c74-465c-bd8a-da21d816a776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:37.540453 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-8d8b37f0-9c74-465c-bd8a-da21d816a776 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1738 microversion: 2.20 time: 0.308157 Aug 17 07:32:37.541006 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 375/752] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:37 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:37.600993 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2a460455-29dc-45fb-8b4b-f9562a35d1f6 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:37.609203 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-2a460455-29dc-45fb-8b4b-f9562a35d1f6 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1314 microversion: 2.1 time: 0.263828 Aug 17 07:32:37.621987 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 378/753] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:37 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:38.563361 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0de65305-7d0a-43e9-a517-6306bc2b4c29 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:38.564613 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0de65305-7d0a-43e9-a517-6306bc2b4c29 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:38.572960 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0de65305-7d0a-43e9-a517-6306bc2b4c29 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:38.573441 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0de65305-7d0a-43e9-a517-6306bc2b4c29 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:38.574114 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0de65305-7d0a-43e9-a517-6306bc2b4c29 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:38.575047 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0de65305-7d0a-43e9-a517-6306bc2b4c29 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:38.575709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0de65305-7d0a-43e9-a517-6306bc2b4c29 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:38.577343 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0de65305-7d0a-43e9-a517-6306bc2b4c29 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:38.630796 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-593fc5ce-deb6-4859-b069-2a51e5f2478b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:38.632031 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-593fc5ce-deb6-4859-b069-2a51e5f2478b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:38.648837 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-593fc5ce-deb6-4859-b069-2a51e5f2478b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:38.649622 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-593fc5ce-deb6-4859-b069-2a51e5f2478b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:38.650283 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-593fc5ce-deb6-4859-b069-2a51e5f2478b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:38.651002 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-593fc5ce-deb6-4859-b069-2a51e5f2478b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:38.651464 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-593fc5ce-deb6-4859-b069-2a51e5f2478b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:38.651896 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-593fc5ce-deb6-4859-b069-2a51e5f2478b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:39.060885 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0de65305-7d0a-43e9-a517-6306bc2b4c29 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:39.071011 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0de65305-7d0a-43e9-a517-6306bc2b4c29 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:39.072558 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0de65305-7d0a-43e9-a517-6306bc2b4c29 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:39.073752 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0de65305-7d0a-43e9-a517-6306bc2b4c29 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1738 microversion: 2.20 time: 0.514354 Aug 17 07:32:39.086486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 376/754] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:38 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1738 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:39.140461 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-593fc5ce-deb6-4859-b069-2a51e5f2478b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:39.149243 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-593fc5ce-deb6-4859-b069-2a51e5f2478b tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1314 microversion: 2.1 time: 0.522253 Aug 17 07:32:39.162797 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 379/755] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:38 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:40.097444 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-6a74bfcf-04ba-4cf4-ab81-c74eb2318563 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:40.098371 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-6a74bfcf-04ba-4cf4-ab81-c74eb2318563 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:40.106015 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6a74bfcf-04ba-4cf4-ab81-c74eb2318563 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:40.106943 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6a74bfcf-04ba-4cf4-ab81-c74eb2318563 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:40.107596 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6a74bfcf-04ba-4cf4-ab81-c74eb2318563 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:40.108515 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6a74bfcf-04ba-4cf4-ab81-c74eb2318563 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:40.109182 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6a74bfcf-04ba-4cf4-ab81-c74eb2318563 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:40.109912 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6a74bfcf-04ba-4cf4-ab81-c74eb2318563 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:40.172104 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-983b7733-08d5-4b19-a548-1d0d7b210330 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:40.172689 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-983b7733-08d5-4b19-a548-1d0d7b210330 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:40.182452 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-983b7733-08d5-4b19-a548-1d0d7b210330 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:40.186292 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-983b7733-08d5-4b19-a548-1d0d7b210330 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:40.186996 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-983b7733-08d5-4b19-a548-1d0d7b210330 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:40.188140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-983b7733-08d5-4b19-a548-1d0d7b210330 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:40.189732 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-983b7733-08d5-4b19-a548-1d0d7b210330 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:40.190471 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-983b7733-08d5-4b19-a548-1d0d7b210330 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:40.360710 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-6a74bfcf-04ba-4cf4-ab81-c74eb2318563 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:40.387627 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-6a74bfcf-04ba-4cf4-ab81-c74eb2318563 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:40.389361 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-6a74bfcf-04ba-4cf4-ab81-c74eb2318563 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:40.390633 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-6a74bfcf-04ba-4cf4-ab81-c74eb2318563 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1738 microversion: 2.20 time: 0.297894 Aug 17 07:32:40.391206 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 377/756] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:40 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1738 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:40.454043 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-983b7733-08d5-4b19-a548-1d0d7b210330 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:40.490352 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-983b7733-08d5-4b19-a548-1d0d7b210330 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1463 microversion: 2.1 time: 0.322228 Aug 17 07:32:40.491525 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 380/757] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:40 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1463 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:32:40.560957 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-979a52ce-48fc-43ea-8f1c-8a1f1b537e46 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:40.561805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-979a52ce-48fc-43ea-8f1c-8a1f1b537e46 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:40.568378 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=100 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:40.572741 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-979a52ce-48fc-43ea-8f1c-8a1f1b537e46 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:40.576919 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-979a52ce-48fc-43ea-8f1c-8a1f1b537e46 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:40.577636 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-979a52ce-48fc-43ea-8f1c-8a1f1b537e46 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:40.578812 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-979a52ce-48fc-43ea-8f1c-8a1f1b537e46 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:40.579701 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-979a52ce-48fc-43ea-8f1c-8a1f1b537e46 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:40.580366 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-979a52ce-48fc-43ea-8f1c-8a1f1b537e46 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:40.792110 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-979a52ce-48fc-43ea-8f1c-8a1f1b537e46 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Going to try to terminate instance {{(pid=120834) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:32:40.915488 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-979a52ce-48fc-43ea-8f1c-8a1f1b537e46 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 204 len: 0 microversion: 2.1 time: 0.358382 Aug 17 07:32:40.916270 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 378/758] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:32:40 2022] DELETE /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:32:40.925377 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-dd8c4be7-a740-4aae-93b6-b87ad08fa65a tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:40.926343 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-dd8c4be7-a740-4aae-93b6-b87ad08fa65a tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:40.933617 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dd8c4be7-a740-4aae-93b6-b87ad08fa65a tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:40.935198 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dd8c4be7-a740-4aae-93b6-b87ad08fa65a tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:40.935805 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dd8c4be7-a740-4aae-93b6-b87ad08fa65a tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:40.938856 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dd8c4be7-a740-4aae-93b6-b87ad08fa65a tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:40.939356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dd8c4be7-a740-4aae-93b6-b87ad08fa65a tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:40.939804 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dd8c4be7-a740-4aae-93b6-b87ad08fa65a tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:41.124593 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-dd8c4be7-a740-4aae-93b6-b87ad08fa65a tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:41.137626 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-dd8c4be7-a740-4aae-93b6-b87ad08fa65a tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1469 microversion: 2.1 time: 0.216740 Aug 17 07:32:41.138927 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 381/759] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:40 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1469 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:41.420656 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9732b4a8-1127-4a9c-ae5f-be2c81b83984 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:41.421636 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9732b4a8-1127-4a9c-ae5f-be2c81b83984 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:41.443948 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9732b4a8-1127-4a9c-ae5f-be2c81b83984 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:41.444521 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9732b4a8-1127-4a9c-ae5f-be2c81b83984 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:41.446702 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9732b4a8-1127-4a9c-ae5f-be2c81b83984 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:41.447735 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9732b4a8-1127-4a9c-ae5f-be2c81b83984 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:41.448373 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9732b4a8-1127-4a9c-ae5f-be2c81b83984 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:41.449012 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9732b4a8-1127-4a9c-ae5f-be2c81b83984 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:41.598884 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-9732b4a8-1127-4a9c-ae5f-be2c81b83984 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:41.607332 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-9732b4a8-1127-4a9c-ae5f-be2c81b83984 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:41.608831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-9732b4a8-1127-4a9c-ae5f-be2c81b83984 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:41.610038 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9732b4a8-1127-4a9c-ae5f-be2c81b83984 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1738 microversion: 2.20 time: 0.193779 Aug 17 07:32:41.610780 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 379/760] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:41 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:42.160928 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-f3df1286-8c26-448f-bae4-8c4ac8ef5063 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:42.162237 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-f3df1286-8c26-448f-bae4-8c4ac8ef5063 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:42.168949 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f3df1286-8c26-448f-bae4-8c4ac8ef5063 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:42.169696 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f3df1286-8c26-448f-bae4-8c4ac8ef5063 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:42.170242 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f3df1286-8c26-448f-bae4-8c4ac8ef5063 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:42.170946 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f3df1286-8c26-448f-bae4-8c4ac8ef5063 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:42.171396 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f3df1286-8c26-448f-bae4-8c4ac8ef5063 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:42.171987 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f3df1286-8c26-448f-bae4-8c4ac8ef5063 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:42.337020 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-f3df1286-8c26-448f-bae4-8c4ac8ef5063 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:42.346284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-f3df1286-8c26-448f-bae4-8c4ac8ef5063 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1469 microversion: 2.1 time: 0.189970 Aug 17 07:32:42.347677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 382/761] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:42 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1469 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:42.633170 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-6a09d77b-4016-4e88-a4dc-1d9479ff46aa tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:42.633782 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-6a09d77b-4016-4e88-a4dc-1d9479ff46aa tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:42.640803 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6a09d77b-4016-4e88-a4dc-1d9479ff46aa tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:42.641534 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6a09d77b-4016-4e88-a4dc-1d9479ff46aa tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:42.641985 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6a09d77b-4016-4e88-a4dc-1d9479ff46aa tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:42.642683 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6a09d77b-4016-4e88-a4dc-1d9479ff46aa tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:42.643160 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6a09d77b-4016-4e88-a4dc-1d9479ff46aa tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:42.644409 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6a09d77b-4016-4e88-a4dc-1d9479ff46aa tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:43.100743 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-6a09d77b-4016-4e88-a4dc-1d9479ff46aa tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:43.108873 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-6a09d77b-4016-4e88-a4dc-1d9479ff46aa tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:43.110406 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-6a09d77b-4016-4e88-a4dc-1d9479ff46aa tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:43.112080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-6a09d77b-4016-4e88-a4dc-1d9479ff46aa tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1738 microversion: 2.20 time: 0.482538 Aug 17 07:32:43.113500 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 380/762] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:42 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1738 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:32:43.376445 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9f063e01-7aed-4575-b29e-f76fa6259135 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:43.377159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-9f063e01-7aed-4575-b29e-f76fa6259135 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:43.384357 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9f063e01-7aed-4575-b29e-f76fa6259135 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:43.385075 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9f063e01-7aed-4575-b29e-f76fa6259135 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:43.385753 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9f063e01-7aed-4575-b29e-f76fa6259135 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:43.386570 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9f063e01-7aed-4575-b29e-f76fa6259135 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:43.387282 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9f063e01-7aed-4575-b29e-f76fa6259135 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:43.387777 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9f063e01-7aed-4575-b29e-f76fa6259135 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:43.653562 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-9f063e01-7aed-4575-b29e-f76fa6259135 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:43.662765 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-9f063e01-7aed-4575-b29e-f76fa6259135 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1469 microversion: 2.1 time: 0.297052 Aug 17 07:32:43.678323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 383/763] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:43 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1469 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:43.713867 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-9cbf4712-224c-486b-967a-b66472c6cb23 req-17d51840-aff3-4847-aeac-e68758f3c5ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70b0da9-1ec1-4631-bcde-ae8bb4177779", "name": "network-vif-deleted", "tag": "a6ff95f4-295c-4b8c-b609-59e2ceb8041a"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:43.738260 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-9cbf4712-224c-486b-967a-b66472c6cb23 req-17d51840-aff3-4847-aeac-e68758f3c5ff service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:43.742964 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-9cbf4712-224c-486b-967a-b66472c6cb23 req-17d51840-aff3-4847-aeac-e68758f3c5ff service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:43.743491 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-9cbf4712-224c-486b-967a-b66472c6cb23 req-17d51840-aff3-4847-aeac-e68758f3c5ff service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:43.764165 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-9cbf4712-224c-486b-967a-b66472c6cb23 req-17d51840-aff3-4847-aeac-e68758f3c5ff service nova] Creating event network-vif-deleted:a6ff95f4-295c-4b8c-b609-59e2ceb8041a for instance c70b0da9-1ec1-4631-bcde-ae8bb4177779 on hv-cinder-85312 Aug 17 07:32:43.773855 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-9cbf4712-224c-486b-967a-b66472c6cb23 req-17d51840-aff3-4847-aeac-e68758f3c5ff service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063937 Aug 17 07:32:43.780907 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 381/764] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:32:44.137185 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ef710b63-4324-4c00-954f-b1b2b6815fdc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:44.138110 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-ef710b63-4324-4c00-954f-b1b2b6815fdc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:44.144322 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef710b63-4324-4c00-954f-b1b2b6815fdc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:44.145036 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef710b63-4324-4c00-954f-b1b2b6815fdc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:44.145687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef710b63-4324-4c00-954f-b1b2b6815fdc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:44.146371 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef710b63-4324-4c00-954f-b1b2b6815fdc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:44.146987 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef710b63-4324-4c00-954f-b1b2b6815fdc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:44.147416 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ef710b63-4324-4c00-954f-b1b2b6815fdc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:44.280126 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ef710b63-4324-4c00-954f-b1b2b6815fdc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:44.288724 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ef710b63-4324-4c00-954f-b1b2b6815fdc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:44.290247 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ef710b63-4324-4c00-954f-b1b2b6815fdc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:44.291424 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-ef710b63-4324-4c00-954f-b1b2b6815fdc tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1720 microversion: 2.20 time: 0.158667 Aug 17 07:32:44.291989 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 384/765] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:44 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:44.685298 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-52918e2b-0acd-4f4f-9086-68a48d8e0911 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:44.686044 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-52918e2b-0acd-4f4f-9086-68a48d8e0911 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:44.692539 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-52918e2b-0acd-4f4f-9086-68a48d8e0911 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:44.693025 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-52918e2b-0acd-4f4f-9086-68a48d8e0911 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:44.693457 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-52918e2b-0acd-4f4f-9086-68a48d8e0911 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:44.694180 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-52918e2b-0acd-4f4f-9086-68a48d8e0911 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:44.694627 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-52918e2b-0acd-4f4f-9086-68a48d8e0911 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:44.695042 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-52918e2b-0acd-4f4f-9086-68a48d8e0911 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:44.726354 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-52918e2b-0acd-4f4f-9086-68a48d8e0911 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:44.727032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-52918e2b-0acd-4f4f-9086-68a48d8e0911 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:44.727267 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-52918e2b-0acd-4f4f-9086-68a48d8e0911 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:44.727695 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.objects.instance [None req-52918e2b-0acd-4f4f-9086-68a48d8e0911 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lazy-loading 'fault' on Instance uuid c70b0da9-1ec1-4631-bcde-ae8bb4177779 {{(pid=120834) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:32:44.769102 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-52918e2b-0acd-4f4f-9086-68a48d8e0911 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:44.776495 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-52918e2b-0acd-4f4f-9086-68a48d8e0911 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1304 microversion: 2.1 time: 0.095569 Aug 17 07:32:44.777044 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 382/766] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:44 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:45.316828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-18acb79c-7350-4bcb-a5fc-74ad6e24e20f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:45.317486 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-18acb79c-7350-4bcb-a5fc-74ad6e24e20f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:45.326530 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-18acb79c-7350-4bcb-a5fc-74ad6e24e20f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:45.327019 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-18acb79c-7350-4bcb-a5fc-74ad6e24e20f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:45.327454 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-18acb79c-7350-4bcb-a5fc-74ad6e24e20f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:45.328173 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-18acb79c-7350-4bcb-a5fc-74ad6e24e20f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:45.328727 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-18acb79c-7350-4bcb-a5fc-74ad6e24e20f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:45.329153 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-18acb79c-7350-4bcb-a5fc-74ad6e24e20f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:45.511839 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-18acb79c-7350-4bcb-a5fc-74ad6e24e20f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:45.520752 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-18acb79c-7350-4bcb-a5fc-74ad6e24e20f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:45.522514 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-18acb79c-7350-4bcb-a5fc-74ad6e24e20f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:45.523808 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-18acb79c-7350-4bcb-a5fc-74ad6e24e20f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1720 microversion: 2.20 time: 0.212451 Aug 17 07:32:45.524789 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 385/767] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:45 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1720 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:45.797858 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-88de3c72-7d4a-4a52-8976-2785ad82cf6d tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:45.798599 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-88de3c72-7d4a-4a52-8976-2785ad82cf6d tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:45.805115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-88de3c72-7d4a-4a52-8976-2785ad82cf6d tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:45.805589 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-88de3c72-7d4a-4a52-8976-2785ad82cf6d tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:45.806053 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-88de3c72-7d4a-4a52-8976-2785ad82cf6d tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:45.806746 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-88de3c72-7d4a-4a52-8976-2785ad82cf6d tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:45.807230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-88de3c72-7d4a-4a52-8976-2785ad82cf6d tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:45.807653 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-88de3c72-7d4a-4a52-8976-2785ad82cf6d tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:45.839442 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-88de3c72-7d4a-4a52-8976-2785ad82cf6d tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:45.839912 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-88de3c72-7d4a-4a52-8976-2785ad82cf6d tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:45.840343 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-88de3c72-7d4a-4a52-8976-2785ad82cf6d tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:45.840782 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.objects.instance [None req-88de3c72-7d4a-4a52-8976-2785ad82cf6d tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lazy-loading 'fault' on Instance uuid c70b0da9-1ec1-4631-bcde-ae8bb4177779 {{(pid=120834) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:32:45.881756 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-88de3c72-7d4a-4a52-8976-2785ad82cf6d tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b8a70d6cf4a46ea9b4de37a34ce97d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecc5bbb9bd84c58af2302dcde767691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:45.899986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-88de3c72-7d4a-4a52-8976-2785ad82cf6d tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 200 len: 1304 microversion: 2.1 time: 0.105960 Aug 17 07:32:45.900700 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 383/768] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:45 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:32:46.389504 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-a9e729d3-b7df-4724-861f-ac3ab6b29942 req-8a066fac-379e-4801-b397-f3435d8269d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c084749b-e2a5-48ae-a864-1ef8c56b5934", "name": "network-vif-unplugged", "status": "completed", "tag": "9ba8e1e3-4b4b-4036-bc27-7a1fb46ead6d"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:46.403940 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-a9e729d3-b7df-4724-861f-ac3ab6b29942 req-8a066fac-379e-4801-b397-f3435d8269d4 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:46.404900 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-a9e729d3-b7df-4724-861f-ac3ab6b29942 req-8a066fac-379e-4801-b397-f3435d8269d4 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:46.405418 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-a9e729d3-b7df-4724-861f-ac3ab6b29942 req-8a066fac-379e-4801-b397-f3435d8269d4 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:46.419138 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.compute.server_external_events [req-a9e729d3-b7df-4724-861f-ac3ab6b29942 req-8a066fac-379e-4801-b397-f3435d8269d4 service nova] Unable to find a host for instance c084749b-e2a5-48ae-a864-1ef8c56b5934. Dropping event network-vif-unplugged {{(pid=120835) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 17 07:32:46.420719 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-a9e729d3-b7df-4724-861f-ac3ab6b29942 req-8a066fac-379e-4801-b397-f3435d8269d4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035659 Aug 17 07:32:46.421574 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 386/769] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 17 07:32:46.547580 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c4092f75-17f8-45fe-8b3c-066badd6b4a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:46.548194 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c4092f75-17f8-45fe-8b3c-066badd6b4a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:46.554637 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c4092f75-17f8-45fe-8b3c-066badd6b4a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:46.555188 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c4092f75-17f8-45fe-8b3c-066badd6b4a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:46.555838 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c4092f75-17f8-45fe-8b3c-066badd6b4a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:46.556898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c4092f75-17f8-45fe-8b3c-066badd6b4a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:46.557361 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c4092f75-17f8-45fe-8b3c-066badd6b4a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:46.557794 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c4092f75-17f8-45fe-8b3c-066badd6b4a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:46.724140 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c4092f75-17f8-45fe-8b3c-066badd6b4a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:46.732160 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c4092f75-17f8-45fe-8b3c-066badd6b4a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:46.733896 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c4092f75-17f8-45fe-8b3c-066badd6b4a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:46.735101 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c4092f75-17f8-45fe-8b3c-066badd6b4a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1663 microversion: 2.20 time: 0.191586 Aug 17 07:32:46.735650 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 384/770] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:46 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1663 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:46.757689 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e48bf891-71f8-4213-b05b-e13431a57aa4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3132a63d-4b2b-47b7-99a5-f1828a8e5b45"}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:46.760189 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e48bf891-71f8-4213-b05b-e13431a57aa4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:46.766420 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e48bf891-71f8-4213-b05b-e13431a57aa4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:46.766899 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e48bf891-71f8-4213-b05b-e13431a57aa4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:46.767332 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e48bf891-71f8-4213-b05b-e13431a57aa4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:46.768026 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e48bf891-71f8-4213-b05b-e13431a57aa4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:46.768981 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e48bf891-71f8-4213-b05b-e13431a57aa4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:46.769408 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e48bf891-71f8-4213-b05b-e13431a57aa4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:46.921096 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c6ca7084-994c-44a8-98bb-d31f821e2846 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:46.921807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c6ca7084-994c-44a8-98bb-d31f821e2846 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] [instance: c70b0da9-1ec1-4631-bcde-ae8bb4177779] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:46.929182 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c6ca7084-994c-44a8-98bb-d31f821e2846 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:46.929840 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c6ca7084-994c-44a8-98bb-d31f821e2846 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:46.930426 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c6ca7084-994c-44a8-98bb-d31f821e2846 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:46.931257 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c6ca7084-994c-44a8-98bb-d31f821e2846 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:46.931827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c6ca7084-994c-44a8-98bb-d31f821e2846 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:46.932397 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c6ca7084-994c-44a8-98bb-d31f821e2846 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:46.947056 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-c6ca7084-994c-44a8-98bb-d31f821e2846 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] HTTP exception thrown: Instance c70b0da9-1ec1-4631-bcde-ae8bb4177779 could not be found. Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c6ca7084-994c-44a8-98bb-d31f821e2846 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Request method failure captured: Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 HTTP/1.1 Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JmFmgxobWLneRCqktszNPNYp2aXOwDgwpANnvhP_5OvXtJgdBWIGygsKJ6cfuieV1Slg6IXf-9qY7BQoFpfKvjG9-fLXkoWiLe7IzQnrABY8TwN3U8Rph-EK9YMdO_ASWAzHzkavqi3vRIkOSrnvwSOScOhru53cd7if-dnpc7xoG8 Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: fecc5bbb9bd84c58af2302dcde767691 Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-VolumesNegativeTest-1491766351 Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:32:46.949127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:32:46.950811 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_fecc5bbb9bd84c58af2302dcde767691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/fecc5bbb9bd84c58af2302dcde767691"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fecc5bbb9bd84c58af2302dcde767691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fecc5bbb9bd84c58af2302dcde767691"}]}] Aug 17 07:32:46.950811 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-VolumesNegativeTest-1491766351 Aug 17 07:32:46.950811 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: fecc5bbb9bd84c58af2302dcde767691 Aug 17 07:32:46.950811 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-VolumesNegativeTest-1491766351 Aug 17 07:32:46.950811 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-VolumesNegativeTest-1491766351-project Aug 17 07:32:46.950811 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:32:46.950811 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:32:46.950811 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: 3b8a70d6cf4a46ea9b4de37a34ce97d6 Aug 17 07:32:46.950811 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-VolumesNegativeTest-1491766351-project Aug 17 07:32:46.950811 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:32:46.950811 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance c70b0da9-1ec1-4631-bcde-ae8bb4177779 could not be found. Aug 17 07:32:46.950811 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': 'c70b0da9-1ec1-4631-bcde-ae8bb4177779'} Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c70b0da9-1ec1-4631-bcde-ae8bb4177779 could not be found. Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:32:46.951730 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:32:46.953216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:32:46.953216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:32:46.953216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:32:46.953216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:32:46.953216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:32:46.953216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:32:46.953216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:32:46.953216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c70b0da9-1ec1-4631-bcde-ae8bb4177779 could not be found. Aug 17 07:32:46.953216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:32:46.953216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:32:46.953216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:32:46.953216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:32:46.953216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:32:46.953216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:32:46.953216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:32:46.953216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:32:46.953216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c70b0da9-1ec1-4631-bcde-ae8bb4177779 could not be found. Aug 17 07:32:46.953216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:32:46.954548 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c6ca7084-994c-44a8-98bb-d31f821e2846 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] Returning 404 to user: Instance c70b0da9-1ec1-4631-bcde-ae8bb4177779 could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:32:46.956902 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c6ca7084-994c-44a8-98bb-d31f821e2846 tempest-VolumesNegativeTest-1491766351 tempest-VolumesNegativeTest-1491766351-project] 10.222.0.45 "GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779" status: 404 len: 111 microversion: 2.1 time: 0.038742 Aug 17 07:32:46.962636 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 385/771] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:32:46 2022] GET /compute/v2.1/servers/c70b0da9-1ec1-4631-bcde-ae8bb4177779 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 07:32:46.971014 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:47.098622 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e48bf891-71f8-4213-b05b-e13431a57aa4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "POST /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.344732 Aug 17 07:32:47.099900 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 387/772] 10.222.0.45 () {62 vars in 1364 bytes} [Wed Aug 17 07:32:46 2022] POST /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934/os-volume_attachments => generated 188 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 07:32:47.226926 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-3de65073-0e6c-4ecf-8967-1a6639b241a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:47.227446 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-3de65073-0e6c-4ecf-8967-1a6639b241a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:47.233629 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3de65073-0e6c-4ecf-8967-1a6639b241a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:47.234169 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3de65073-0e6c-4ecf-8967-1a6639b241a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:47.234626 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3de65073-0e6c-4ecf-8967-1a6639b241a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:47.235296 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3de65073-0e6c-4ecf-8967-1a6639b241a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:47.235776 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3de65073-0e6c-4ecf-8967-1a6639b241a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:47.236199 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3de65073-0e6c-4ecf-8967-1a6639b241a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:47.476970 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-3de65073-0e6c-4ecf-8967-1a6639b241a4 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934/os-volume_attachments/3132a63d-4b2b-47b7-99a5-f1828a8e5b45" status: 202 len: 0 microversion: 2.20 time: 0.254298 Aug 17 07:32:47.477665 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 386/773] 10.222.0.45 () {60 vars in 1457 bytes} [Wed Aug 17 07:32:47 2022] DELETE /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934/os-volume_attachments/3132a63d-4b2b-47b7-99a5-f1828a8e5b45 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:32:47.542386 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-519096e2-3894-41a4-8b39-beb5a0bf1ab6 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:32:47.542995 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-519096e2-3894-41a4-8b39-beb5a0bf1ab6 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:47.550315 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-519096e2-3894-41a4-8b39-beb5a0bf1ab6 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:47.550801 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-519096e2-3894-41a4-8b39-beb5a0bf1ab6 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:47.551244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-519096e2-3894-41a4-8b39-beb5a0bf1ab6 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:47.551940 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-519096e2-3894-41a4-8b39-beb5a0bf1ab6 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:47.552394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-519096e2-3894-41a4-8b39-beb5a0bf1ab6 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:47.552826 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-519096e2-3894-41a4-8b39-beb5a0bf1ab6 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:47.582067 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-519096e2-3894-41a4-8b39-beb5a0bf1ab6 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120835) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 07:32:47.648948 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-519096e2-3894-41a4-8b39-beb5a0bf1ab6 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "POST /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934/action" status: 202 len: 0 microversion: 2.20 time: 0.110663 Aug 17 07:32:47.649655 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 388/774] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 17 07:32:47 2022] POST /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 17 07:32:47.657554 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-75e94a44-c3ed-4668-bbca-acadf749cb5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:47.658312 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-75e94a44-c3ed-4668-bbca-acadf749cb5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:47.665621 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-75e94a44-c3ed-4668-bbca-acadf749cb5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:47.666141 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-75e94a44-c3ed-4668-bbca-acadf749cb5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:47.666733 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-75e94a44-c3ed-4668-bbca-acadf749cb5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:47.667643 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-75e94a44-c3ed-4668-bbca-acadf749cb5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:47.668408 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-75e94a44-c3ed-4668-bbca-acadf749cb5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:47.668989 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-75e94a44-c3ed-4668-bbca-acadf749cb5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:47.808464 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-75e94a44-c3ed-4668-bbca-acadf749cb5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:47.812222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:47.823005 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-75e94a44-c3ed-4668-bbca-acadf749cb5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:47.824640 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-75e94a44-c3ed-4668-bbca-acadf749cb5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:47.826049 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-75e94a44-c3ed-4668-bbca-acadf749cb5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1671 microversion: 2.20 time: 0.172300 Aug 17 07:32:47.826825 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 387/775] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:47 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:48.850332 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-dc99b4c5-ba57-423d-b5f4-eabb9e373aab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:48.851334 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-dc99b4c5-ba57-423d-b5f4-eabb9e373aab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:48.858280 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dc99b4c5-ba57-423d-b5f4-eabb9e373aab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:48.858863 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dc99b4c5-ba57-423d-b5f4-eabb9e373aab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:48.859392 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dc99b4c5-ba57-423d-b5f4-eabb9e373aab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:48.860290 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dc99b4c5-ba57-423d-b5f4-eabb9e373aab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:48.860950 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dc99b4c5-ba57-423d-b5f4-eabb9e373aab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:48.861624 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dc99b4c5-ba57-423d-b5f4-eabb9e373aab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:49.012661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-dc99b4c5-ba57-423d-b5f4-eabb9e373aab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:49.021623 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-dc99b4c5-ba57-423d-b5f4-eabb9e373aab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:49.023126 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-dc99b4c5-ba57-423d-b5f4-eabb9e373aab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:49.024276 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-dc99b4c5-ba57-423d-b5f4-eabb9e373aab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.179414 Aug 17 07:32:49.025316 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 389/776] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:48 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:50.048847 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-281c69b1-8360-4eec-96eb-735db8f01335 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:50.050304 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-281c69b1-8360-4eec-96eb-735db8f01335 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:50.059591 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-281c69b1-8360-4eec-96eb-735db8f01335 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:50.060248 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-281c69b1-8360-4eec-96eb-735db8f01335 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:50.060697 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-281c69b1-8360-4eec-96eb-735db8f01335 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:50.061404 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-281c69b1-8360-4eec-96eb-735db8f01335 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:50.061862 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-281c69b1-8360-4eec-96eb-735db8f01335 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:50.062361 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-281c69b1-8360-4eec-96eb-735db8f01335 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:50.200757 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-281c69b1-8360-4eec-96eb-735db8f01335 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:50.209112 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-281c69b1-8360-4eec-96eb-735db8f01335 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:50.210769 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-281c69b1-8360-4eec-96eb-735db8f01335 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:50.212151 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-281c69b1-8360-4eec-96eb-735db8f01335 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.168618 Aug 17 07:32:50.212701 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 388/777] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:50 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:32:51.235309 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-621ac56c-9045-4b06-a835-4fa0acabff63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:51.235934 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-621ac56c-9045-4b06-a835-4fa0acabff63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:51.243513 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-621ac56c-9045-4b06-a835-4fa0acabff63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:51.244222 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-621ac56c-9045-4b06-a835-4fa0acabff63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:51.244868 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-621ac56c-9045-4b06-a835-4fa0acabff63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:51.245573 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-621ac56c-9045-4b06-a835-4fa0acabff63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:51.246231 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-621ac56c-9045-4b06-a835-4fa0acabff63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:51.246690 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-621ac56c-9045-4b06-a835-4fa0acabff63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:51.450031 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-621ac56c-9045-4b06-a835-4fa0acabff63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:51.462295 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-621ac56c-9045-4b06-a835-4fa0acabff63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:51.467054 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-621ac56c-9045-4b06-a835-4fa0acabff63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:51.468355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-621ac56c-9045-4b06-a835-4fa0acabff63 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.237030 Aug 17 07:32:51.474064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 390/778] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:51 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:52.497955 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-34db1d03-1a9b-468c-b31a-32cd3ef05942 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:52.498591 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-34db1d03-1a9b-468c-b31a-32cd3ef05942 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:52.505840 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-34db1d03-1a9b-468c-b31a-32cd3ef05942 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:52.506789 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-34db1d03-1a9b-468c-b31a-32cd3ef05942 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:52.507557 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-34db1d03-1a9b-468c-b31a-32cd3ef05942 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:52.508731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-34db1d03-1a9b-468c-b31a-32cd3ef05942 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:52.509340 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-34db1d03-1a9b-468c-b31a-32cd3ef05942 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:52.510258 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-34db1d03-1a9b-468c-b31a-32cd3ef05942 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:52.679517 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-34db1d03-1a9b-468c-b31a-32cd3ef05942 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:52.691769 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-34db1d03-1a9b-468c-b31a-32cd3ef05942 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:52.693299 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-34db1d03-1a9b-468c-b31a-32cd3ef05942 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:52.694505 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-34db1d03-1a9b-468c-b31a-32cd3ef05942 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.200489 Aug 17 07:32:52.695231 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 389/779] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:52 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:53.730444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9fbc5465-7138-4579-836c-0892f51bc5ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:53.734132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-9fbc5465-7138-4579-836c-0892f51bc5ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:53.742443 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9fbc5465-7138-4579-836c-0892f51bc5ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:53.743065 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9fbc5465-7138-4579-836c-0892f51bc5ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:53.743823 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9fbc5465-7138-4579-836c-0892f51bc5ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:53.744721 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9fbc5465-7138-4579-836c-0892f51bc5ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:53.745173 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9fbc5465-7138-4579-836c-0892f51bc5ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:53.745905 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9fbc5465-7138-4579-836c-0892f51bc5ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:53.916231 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-9fbc5465-7138-4579-836c-0892f51bc5ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:53.929087 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-9fbc5465-7138-4579-836c-0892f51bc5ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:53.931162 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-9fbc5465-7138-4579-836c-0892f51bc5ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:53.932605 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-9fbc5465-7138-4579-836c-0892f51bc5ab tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.218318 Aug 17 07:32:53.933629 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 391/780] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:53 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:54.956553 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a2b3dbee-ff90-41dd-9853-b82920eaf5f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:54.957782 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-a2b3dbee-ff90-41dd-9853-b82920eaf5f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:54.964590 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a2b3dbee-ff90-41dd-9853-b82920eaf5f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:54.965071 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a2b3dbee-ff90-41dd-9853-b82920eaf5f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:54.965507 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a2b3dbee-ff90-41dd-9853-b82920eaf5f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:54.966234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a2b3dbee-ff90-41dd-9853-b82920eaf5f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:54.966688 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a2b3dbee-ff90-41dd-9853-b82920eaf5f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:54.967134 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a2b3dbee-ff90-41dd-9853-b82920eaf5f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:55.096596 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a2b3dbee-ff90-41dd-9853-b82920eaf5f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:55.106618 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a2b3dbee-ff90-41dd-9853-b82920eaf5f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:55.108129 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a2b3dbee-ff90-41dd-9853-b82920eaf5f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:55.109391 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a2b3dbee-ff90-41dd-9853-b82920eaf5f8 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.156726 Aug 17 07:32:55.110463 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 390/781] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:54 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:56.132880 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-87c47df6-4c27-4602-b095-68682623cc9f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:56.133479 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-87c47df6-4c27-4602-b095-68682623cc9f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:56.139824 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87c47df6-4c27-4602-b095-68682623cc9f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:56.140295 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87c47df6-4c27-4602-b095-68682623cc9f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:56.140725 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87c47df6-4c27-4602-b095-68682623cc9f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:56.141414 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87c47df6-4c27-4602-b095-68682623cc9f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:56.141861 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87c47df6-4c27-4602-b095-68682623cc9f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:56.142307 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87c47df6-4c27-4602-b095-68682623cc9f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:56.285600 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-87c47df6-4c27-4602-b095-68682623cc9f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:56.294212 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-87c47df6-4c27-4602-b095-68682623cc9f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:56.295715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-87c47df6-4c27-4602-b095-68682623cc9f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:56.296881 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-87c47df6-4c27-4602-b095-68682623cc9f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.167861 Aug 17 07:32:56.297519 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 392/782] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:56 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:57.320276 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0988a9af-6fae-4949-8a26-b2ec4545e584 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:57.320838 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0988a9af-6fae-4949-8a26-b2ec4545e584 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:57.328020 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0988a9af-6fae-4949-8a26-b2ec4545e584 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:57.328649 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0988a9af-6fae-4949-8a26-b2ec4545e584 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:57.329075 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0988a9af-6fae-4949-8a26-b2ec4545e584 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:57.329778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0988a9af-6fae-4949-8a26-b2ec4545e584 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:57.330263 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0988a9af-6fae-4949-8a26-b2ec4545e584 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:57.330688 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0988a9af-6fae-4949-8a26-b2ec4545e584 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:57.487643 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0988a9af-6fae-4949-8a26-b2ec4545e584 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:57.497398 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0988a9af-6fae-4949-8a26-b2ec4545e584 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:57.498935 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0988a9af-6fae-4949-8a26-b2ec4545e584 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:57.500426 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0988a9af-6fae-4949-8a26-b2ec4545e584 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.184013 Aug 17 07:32:57.513255 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 391/783] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:57 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:58.523389 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d0d64319-eb3a-47a0-804f-e8e0b667bb49 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:58.523997 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d0d64319-eb3a-47a0-804f-e8e0b667bb49 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:58.530438 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d0d64319-eb3a-47a0-804f-e8e0b667bb49 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:58.530910 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d0d64319-eb3a-47a0-804f-e8e0b667bb49 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:58.531337 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d0d64319-eb3a-47a0-804f-e8e0b667bb49 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:58.532007 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d0d64319-eb3a-47a0-804f-e8e0b667bb49 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:58.532454 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d0d64319-eb3a-47a0-804f-e8e0b667bb49 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:58.532871 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d0d64319-eb3a-47a0-804f-e8e0b667bb49 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:58.662870 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d0d64319-eb3a-47a0-804f-e8e0b667bb49 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:58.670662 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d0d64319-eb3a-47a0-804f-e8e0b667bb49 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:58.672152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d0d64319-eb3a-47a0-804f-e8e0b667bb49 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:58.673304 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d0d64319-eb3a-47a0-804f-e8e0b667bb49 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.153768 Aug 17 07:32:58.673908 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 393/784] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:58 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:32:59.697150 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-79b721bf-1e7a-4ee7-80fa-199e0d88dd9a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:32:59.697772 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-79b721bf-1e7a-4ee7-80fa-199e0d88dd9a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:32:59.704062 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-79b721bf-1e7a-4ee7-80fa-199e0d88dd9a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:59.704534 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-79b721bf-1e7a-4ee7-80fa-199e0d88dd9a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:59.704960 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-79b721bf-1e7a-4ee7-80fa-199e0d88dd9a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:59.705635 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-79b721bf-1e7a-4ee7-80fa-199e0d88dd9a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:32:59.706124 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-79b721bf-1e7a-4ee7-80fa-199e0d88dd9a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:32:59.706541 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-79b721bf-1e7a-4ee7-80fa-199e0d88dd9a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:32:59.835497 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-79b721bf-1e7a-4ee7-80fa-199e0d88dd9a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:59.843253 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-79b721bf-1e7a-4ee7-80fa-199e0d88dd9a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:59.844747 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-79b721bf-1e7a-4ee7-80fa-199e0d88dd9a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:32:59.845875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-79b721bf-1e7a-4ee7-80fa-199e0d88dd9a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.152610 Aug 17 07:32:59.846444 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 392/785] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:32:59 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:33:00.869397 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-676ef6e0-ea73-4afc-9121-bc4dfb041818 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:00.870034 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-676ef6e0-ea73-4afc-9121-bc4dfb041818 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:00.876051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-676ef6e0-ea73-4afc-9121-bc4dfb041818 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:00.876525 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-676ef6e0-ea73-4afc-9121-bc4dfb041818 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:00.876960 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-676ef6e0-ea73-4afc-9121-bc4dfb041818 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:00.877640 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-676ef6e0-ea73-4afc-9121-bc4dfb041818 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:00.878126 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-676ef6e0-ea73-4afc-9121-bc4dfb041818 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:00.878552 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-676ef6e0-ea73-4afc-9121-bc4dfb041818 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:01.008200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-676ef6e0-ea73-4afc-9121-bc4dfb041818 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:01.016022 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-676ef6e0-ea73-4afc-9121-bc4dfb041818 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:01.017507 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-676ef6e0-ea73-4afc-9121-bc4dfb041818 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:01.018681 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-676ef6e0-ea73-4afc-9121-bc4dfb041818 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.153781 Aug 17 07:33:01.019240 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 394/786] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:33:00 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:33:02.042093 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ede5e4d1-16ca-4c1a-84f5-67f731fb4199 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:02.042703 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ede5e4d1-16ca-4c1a-84f5-67f731fb4199 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:02.049153 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ede5e4d1-16ca-4c1a-84f5-67f731fb4199 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:02.049630 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ede5e4d1-16ca-4c1a-84f5-67f731fb4199 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:02.050094 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ede5e4d1-16ca-4c1a-84f5-67f731fb4199 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:02.050781 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ede5e4d1-16ca-4c1a-84f5-67f731fb4199 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:02.051232 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ede5e4d1-16ca-4c1a-84f5-67f731fb4199 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:02.051657 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ede5e4d1-16ca-4c1a-84f5-67f731fb4199 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:02.192440 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ede5e4d1-16ca-4c1a-84f5-67f731fb4199 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:02.201134 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ede5e4d1-16ca-4c1a-84f5-67f731fb4199 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:02.202720 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ede5e4d1-16ca-4c1a-84f5-67f731fb4199 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:02.203916 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ede5e4d1-16ca-4c1a-84f5-67f731fb4199 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.165761 Aug 17 07:33:02.204479 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 393/787] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:33:02 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:33:03.227916 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-729355a3-2269-4ed7-970b-d20e3f0f0548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:03.228503 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-729355a3-2269-4ed7-970b-d20e3f0f0548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:03.234817 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-729355a3-2269-4ed7-970b-d20e3f0f0548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:03.235294 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-729355a3-2269-4ed7-970b-d20e3f0f0548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:03.235723 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-729355a3-2269-4ed7-970b-d20e3f0f0548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:03.236399 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-729355a3-2269-4ed7-970b-d20e3f0f0548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:03.236844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-729355a3-2269-4ed7-970b-d20e3f0f0548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:03.237265 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-729355a3-2269-4ed7-970b-d20e3f0f0548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:03.365983 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-729355a3-2269-4ed7-970b-d20e3f0f0548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:03.374164 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-729355a3-2269-4ed7-970b-d20e3f0f0548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:03.375650 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-729355a3-2269-4ed7-970b-d20e3f0f0548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:03.376785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-729355a3-2269-4ed7-970b-d20e3f0f0548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.153497 Aug 17 07:33:03.377345 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 395/788] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:33:03 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:33:04.399157 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ed268140-4bb3-4972-961d-5274d580700e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:04.399798 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ed268140-4bb3-4972-961d-5274d580700e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:04.406215 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ed268140-4bb3-4972-961d-5274d580700e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:04.406704 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ed268140-4bb3-4972-961d-5274d580700e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:04.407133 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ed268140-4bb3-4972-961d-5274d580700e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:04.407823 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ed268140-4bb3-4972-961d-5274d580700e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:04.408272 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ed268140-4bb3-4972-961d-5274d580700e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:04.408698 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ed268140-4bb3-4972-961d-5274d580700e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:04.535456 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ed268140-4bb3-4972-961d-5274d580700e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:04.543234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ed268140-4bb3-4972-961d-5274d580700e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:04.544754 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ed268140-4bb3-4972-961d-5274d580700e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:04.545888 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ed268140-4bb3-4972-961d-5274d580700e tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.150829 Aug 17 07:33:04.546465 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 394/789] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:33:04 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:33:05.569312 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-41d74129-565d-4c52-95e5-dc5c1139d190 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:05.569920 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-41d74129-565d-4c52-95e5-dc5c1139d190 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:05.576344 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-41d74129-565d-4c52-95e5-dc5c1139d190 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:05.576822 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-41d74129-565d-4c52-95e5-dc5c1139d190 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:05.577254 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-41d74129-565d-4c52-95e5-dc5c1139d190 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:05.577934 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-41d74129-565d-4c52-95e5-dc5c1139d190 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:05.578413 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-41d74129-565d-4c52-95e5-dc5c1139d190 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:05.578838 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-41d74129-565d-4c52-95e5-dc5c1139d190 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:05.710114 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-41d74129-565d-4c52-95e5-dc5c1139d190 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:05.717877 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-41d74129-565d-4c52-95e5-dc5c1139d190 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:05.719399 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-41d74129-565d-4c52-95e5-dc5c1139d190 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:05.720516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-41d74129-565d-4c52-95e5-dc5c1139d190 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.155822 Aug 17 07:33:05.721067 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 396/790] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:33:05 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:33:06.743648 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-eea61991-4d5d-42af-8458-a39a13534a65 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:06.744262 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-eea61991-4d5d-42af-8458-a39a13534a65 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:06.750734 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-eea61991-4d5d-42af-8458-a39a13534a65 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:06.751215 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-eea61991-4d5d-42af-8458-a39a13534a65 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:06.751657 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-eea61991-4d5d-42af-8458-a39a13534a65 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:06.752348 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-eea61991-4d5d-42af-8458-a39a13534a65 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:06.752803 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-eea61991-4d5d-42af-8458-a39a13534a65 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:06.753234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-eea61991-4d5d-42af-8458-a39a13534a65 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:06.890970 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-eea61991-4d5d-42af-8458-a39a13534a65 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:06.900441 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-eea61991-4d5d-42af-8458-a39a13534a65 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:06.901926 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-eea61991-4d5d-42af-8458-a39a13534a65 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:06.903084 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-eea61991-4d5d-42af-8458-a39a13534a65 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.163584 Aug 17 07:33:06.910404 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 395/791] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:33:06 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:33:07.926501 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a3774956-b1d0-4721-93ef-09fef3c55eb1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:07.927042 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a3774956-b1d0-4721-93ef-09fef3c55eb1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:07.930454 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:07.934337 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a3774956-b1d0-4721-93ef-09fef3c55eb1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:07.934811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a3774956-b1d0-4721-93ef-09fef3c55eb1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:07.935242 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a3774956-b1d0-4721-93ef-09fef3c55eb1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:07.935914 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a3774956-b1d0-4721-93ef-09fef3c55eb1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:07.936357 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a3774956-b1d0-4721-93ef-09fef3c55eb1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:07.936773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a3774956-b1d0-4721-93ef-09fef3c55eb1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:08.065567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a3774956-b1d0-4721-93ef-09fef3c55eb1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:08.073327 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a3774956-b1d0-4721-93ef-09fef3c55eb1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:08.074857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a3774956-b1d0-4721-93ef-09fef3c55eb1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:08.075997 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a3774956-b1d0-4721-93ef-09fef3c55eb1 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.153536 Aug 17 07:33:08.076557 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 397/792] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:33:07 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:33:08.500579 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-4c434d46-698f-40bd-afc3-f4ce406e3eb8 req-5bf91242-527f-47d4-8061-4e73df6b39eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c084749b-e2a5-48ae-a864-1ef8c56b5934", "name": "network-vif-plugged", "status": "completed", "tag": "9ba8e1e3-4b4b-4036-bc27-7a1fb46ead6d"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:33:08.511166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-4c434d46-698f-40bd-afc3-f4ce406e3eb8 req-5bf91242-527f-47d4-8061-4e73df6b39eb service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:08.511647 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-4c434d46-698f-40bd-afc3-f4ce406e3eb8 req-5bf91242-527f-47d4-8061-4e73df6b39eb service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:08.512076 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-4c434d46-698f-40bd-afc3-f4ce406e3eb8 req-5bf91242-527f-47d4-8061-4e73df6b39eb service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:08.523450 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-4c434d46-698f-40bd-afc3-f4ce406e3eb8 req-5bf91242-527f-47d4-8061-4e73df6b39eb service nova] Creating event network-vif-plugged:9ba8e1e3-4b4b-4036-bc27-7a1fb46ead6d for instance c084749b-e2a5-48ae-a864-1ef8c56b5934 on hv-cinder-85312 Aug 17 07:33:08.528690 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-4c434d46-698f-40bd-afc3-f4ce406e3eb8 req-5bf91242-527f-47d4-8061-4e73df6b39eb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031750 Aug 17 07:33:08.529868 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 396/793] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:09.099799 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-f4230b88-39dc-4a8b-a840-8e997493186d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:09.100413 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-f4230b88-39dc-4a8b-a840-8e997493186d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:09.106845 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f4230b88-39dc-4a8b-a840-8e997493186d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:09.107328 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f4230b88-39dc-4a8b-a840-8e997493186d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:09.107765 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f4230b88-39dc-4a8b-a840-8e997493186d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:09.108453 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f4230b88-39dc-4a8b-a840-8e997493186d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:09.108909 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f4230b88-39dc-4a8b-a840-8e997493186d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:09.109336 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f4230b88-39dc-4a8b-a840-8e997493186d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:09.236232 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-f4230b88-39dc-4a8b-a840-8e997493186d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:09.244196 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-f4230b88-39dc-4a8b-a840-8e997493186d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:09.245672 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-f4230b88-39dc-4a8b-a840-8e997493186d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:09.246836 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-f4230b88-39dc-4a8b-a840-8e997493186d tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.151561 Aug 17 07:33:09.247403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 398/794] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:33:09 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:33:10.269259 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f4b5fec9-71b6-4528-a253-495944edb387 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:10.269977 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f4b5fec9-71b6-4528-a253-495944edb387 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:10.276694 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f4b5fec9-71b6-4528-a253-495944edb387 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:10.277199 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f4b5fec9-71b6-4528-a253-495944edb387 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:10.277633 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f4b5fec9-71b6-4528-a253-495944edb387 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:10.278405 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f4b5fec9-71b6-4528-a253-495944edb387 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:10.278897 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f4b5fec9-71b6-4528-a253-495944edb387 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:10.279320 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f4b5fec9-71b6-4528-a253-495944edb387 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:10.406345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f4b5fec9-71b6-4528-a253-495944edb387 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:10.414804 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f4b5fec9-71b6-4528-a253-495944edb387 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:10.416314 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f4b5fec9-71b6-4528-a253-495944edb387 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:10.417509 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f4b5fec9-71b6-4528-a253-495944edb387 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1729 microversion: 2.20 time: 0.152560 Aug 17 07:33:10.418081 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 397/795] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:33:10 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:33:11.440614 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-05fb2a3a-cfa4-4470-a40f-134977ffd918 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:11.441224 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-05fb2a3a-cfa4-4470-a40f-134977ffd918 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:11.447575 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-05fb2a3a-cfa4-4470-a40f-134977ffd918 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:11.448080 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-05fb2a3a-cfa4-4470-a40f-134977ffd918 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:11.448514 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-05fb2a3a-cfa4-4470-a40f-134977ffd918 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:11.449196 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-05fb2a3a-cfa4-4470-a40f-134977ffd918 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:11.449644 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-05fb2a3a-cfa4-4470-a40f-134977ffd918 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:11.450123 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-05fb2a3a-cfa4-4470-a40f-134977ffd918 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:11.581983 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-05fb2a3a-cfa4-4470-a40f-134977ffd918 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:11.590734 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-05fb2a3a-cfa4-4470-a40f-134977ffd918 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:11.592225 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-05fb2a3a-cfa4-4470-a40f-134977ffd918 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:11.593374 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-05fb2a3a-cfa4-4470-a40f-134977ffd918 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1716 microversion: 2.20 time: 0.156697 Aug 17 07:33:11.593933 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 399/796] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:33:11 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:33:16.345743 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1ecc8014-1b78-4bce-9083-d6f1556d4310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:16.346357 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-1ecc8014-1b78-4bce-9083-d6f1556d4310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:16.348810 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:16.354166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1ecc8014-1b78-4bce-9083-d6f1556d4310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:16.354645 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1ecc8014-1b78-4bce-9083-d6f1556d4310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:16.355077 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1ecc8014-1b78-4bce-9083-d6f1556d4310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:16.355761 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1ecc8014-1b78-4bce-9083-d6f1556d4310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:16.356206 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1ecc8014-1b78-4bce-9083-d6f1556d4310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:16.356627 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1ecc8014-1b78-4bce-9083-d6f1556d4310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:16.382944 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-1ecc8014-1b78-4bce-9083-d6f1556d4310 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/ips" status: 200 len: 151 microversion: 2.1 time: 0.041187 Aug 17 07:33:16.383500 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 398/797] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 17 07:33:16 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:17.704354 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-f54ef562-912d-4dfa-a6d5-cc5949e5e83f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6df13b01-c14a-43fd-9ca6-e27302fa42a1"}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:33:17.706773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-f54ef562-912d-4dfa-a6d5-cc5949e5e83f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:17.712890 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f54ef562-912d-4dfa-a6d5-cc5949e5e83f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:17.713365 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f54ef562-912d-4dfa-a6d5-cc5949e5e83f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:17.713801 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f54ef562-912d-4dfa-a6d5-cc5949e5e83f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:17.714512 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f54ef562-912d-4dfa-a6d5-cc5949e5e83f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:17.714964 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f54ef562-912d-4dfa-a6d5-cc5949e5e83f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:17.715388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-f54ef562-912d-4dfa-a6d5-cc5949e5e83f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:17.718919 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:17.956568 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-f54ef562-912d-4dfa-a6d5-cc5949e5e83f tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "POST /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256015 Aug 17 07:33:17.957334 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 400/798] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 17 07:33:17 2022] POST /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:22.474971 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-110d0ff5-b7e1-4a37-9b39-6bfa36f7ef75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:22.475459 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-110d0ff5-b7e1-4a37-9b39-6bfa36f7ef75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:22.482142 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-110d0ff5-b7e1-4a37-9b39-6bfa36f7ef75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:22.482618 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-110d0ff5-b7e1-4a37-9b39-6bfa36f7ef75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:22.483048 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-110d0ff5-b7e1-4a37-9b39-6bfa36f7ef75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:22.483726 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-110d0ff5-b7e1-4a37-9b39-6bfa36f7ef75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:22.484173 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-110d0ff5-b7e1-4a37-9b39-6bfa36f7ef75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:22.484593 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-110d0ff5-b7e1-4a37-9b39-6bfa36f7ef75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:22.486922 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=61 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:22.508659 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-110d0ff5-b7e1-4a37-9b39-6bfa36f7ef75 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/ips" status: 200 len: 145 microversion: 2.1 time: 0.038106 Aug 17 07:33:22.509220 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 399/799] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 17 07:33:22 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:23.832905 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ca3becf7-594f-4d1c-a4ab-bad1e60a61fe tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46cccf47-d476-4608-a413-07391ed75075"}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:33:23.835409 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-ca3becf7-594f-4d1c-a4ab-bad1e60a61fe tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:23.841472 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ca3becf7-594f-4d1c-a4ab-bad1e60a61fe tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:23.841955 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ca3becf7-594f-4d1c-a4ab-bad1e60a61fe tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:23.842430 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ca3becf7-594f-4d1c-a4ab-bad1e60a61fe tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:23.843120 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ca3becf7-594f-4d1c-a4ab-bad1e60a61fe tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:23.843576 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ca3becf7-594f-4d1c-a4ab-bad1e60a61fe tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:23.844003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ca3becf7-594f-4d1c-a4ab-bad1e60a61fe tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:24.108633 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-ca3becf7-594f-4d1c-a4ab-bad1e60a61fe tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "POST /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280328 Aug 17 07:33:24.109474 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 401/800] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 17 07:33:23 2022] POST /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:25.569757 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-4781f677-c88c-4f94-8ab0-8740e5c29559 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:25.570395 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-4781f677-c88c-4f94-8ab0-8740e5c29559 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:25.576796 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4781f677-c88c-4f94-8ab0-8740e5c29559 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:25.577272 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4781f677-c88c-4f94-8ab0-8740e5c29559 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:25.577707 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4781f677-c88c-4f94-8ab0-8740e5c29559 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:25.578426 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4781f677-c88c-4f94-8ab0-8740e5c29559 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:25.578874 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4781f677-c88c-4f94-8ab0-8740e5c29559 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:25.579294 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4781f677-c88c-4f94-8ab0-8740e5c29559 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:25.658025 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.objects.instance [None req-4781f677-c88c-4f94-8ab0-8740e5c29559 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lazy-loading 'services' on Instance uuid f7dc7f93-7079-4b42-a379-f28a28546aaa {{(pid=120834) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:33:25.727106 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-4781f677-c88c-4f94-8ab0-8740e5c29559 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-volume_attachments/6df13b01-c14a-43fd-9ca6-e27302fa42a1" status: 202 len: 0 microversion: 2.1 time: 0.161637 Aug 17 07:33:25.727740 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 400/801] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 17 07:33:25 2022] DELETE /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-volume_attachments/6df13b01-c14a-43fd-9ca6-e27302fa42a1 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:33:25.737640 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-db08c6e0-09e8-4849-be24-44ae9c9bba03 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:25.739934 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-db08c6e0-09e8-4849-be24-44ae9c9bba03 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:25.747211 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-db08c6e0-09e8-4849-be24-44ae9c9bba03 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:25.747737 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-db08c6e0-09e8-4849-be24-44ae9c9bba03 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:25.748284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-db08c6e0-09e8-4849-be24-44ae9c9bba03 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:25.748986 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-db08c6e0-09e8-4849-be24-44ae9c9bba03 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:25.749441 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-db08c6e0-09e8-4849-be24-44ae9c9bba03 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:25.749873 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-db08c6e0-09e8-4849-be24-44ae9c9bba03 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:25.780194 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-db08c6e0-09e8-4849-be24-44ae9c9bba03 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047897 Aug 17 07:33:25.780750 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 402/802] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:33:25 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:26.793532 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-054aecc4-fa83-45ff-8f63-e1dc77743252 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:26.795957 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-054aecc4-fa83-45ff-8f63-e1dc77743252 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:26.802143 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-054aecc4-fa83-45ff-8f63-e1dc77743252 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:26.802631 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-054aecc4-fa83-45ff-8f63-e1dc77743252 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:26.803067 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-054aecc4-fa83-45ff-8f63-e1dc77743252 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:26.803752 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-054aecc4-fa83-45ff-8f63-e1dc77743252 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:26.804198 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-054aecc4-fa83-45ff-8f63-e1dc77743252 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:26.804618 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-054aecc4-fa83-45ff-8f63-e1dc77743252 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:26.832703 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-054aecc4-fa83-45ff-8f63-e1dc77743252 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044024 Aug 17 07:33:26.833240 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 401/803] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:33:26 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:27.844181 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-361883ec-3249-441e-bc60-cfab9a5a89c5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:27.846889 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-361883ec-3249-441e-bc60-cfab9a5a89c5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:27.853257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-361883ec-3249-441e-bc60-cfab9a5a89c5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:27.853739 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-361883ec-3249-441e-bc60-cfab9a5a89c5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:27.854209 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-361883ec-3249-441e-bc60-cfab9a5a89c5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:27.854894 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-361883ec-3249-441e-bc60-cfab9a5a89c5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:27.855346 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-361883ec-3249-441e-bc60-cfab9a5a89c5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:27.855770 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-361883ec-3249-441e-bc60-cfab9a5a89c5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:27.884371 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-361883ec-3249-441e-bc60-cfab9a5a89c5 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044126 Aug 17 07:33:27.884915 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 403/804] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:33:27 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:28.896914 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-529e96cd-370b-4888-84f4-8beef3d72cb6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:28.899034 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-529e96cd-370b-4888-84f4-8beef3d72cb6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:28.905251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-529e96cd-370b-4888-84f4-8beef3d72cb6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:28.905723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-529e96cd-370b-4888-84f4-8beef3d72cb6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:28.906189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-529e96cd-370b-4888-84f4-8beef3d72cb6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:28.906865 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-529e96cd-370b-4888-84f4-8beef3d72cb6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:28.907308 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-529e96cd-370b-4888-84f4-8beef3d72cb6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:28.907728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-529e96cd-370b-4888-84f4-8beef3d72cb6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:28.936560 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-529e96cd-370b-4888-84f4-8beef3d72cb6 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043836 Aug 17 07:33:28.937104 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 402/805] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:33:28 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:29.948824 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-8ebc9a24-48a4-4d74-808b-3bc3ebdbec46 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:29.951039 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-8ebc9a24-48a4-4d74-808b-3bc3ebdbec46 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:29.958095 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8ebc9a24-48a4-4d74-808b-3bc3ebdbec46 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:29.958574 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8ebc9a24-48a4-4d74-808b-3bc3ebdbec46 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:29.959004 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8ebc9a24-48a4-4d74-808b-3bc3ebdbec46 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:29.959682 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8ebc9a24-48a4-4d74-808b-3bc3ebdbec46 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:29.960128 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8ebc9a24-48a4-4d74-808b-3bc3ebdbec46 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:29.960541 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8ebc9a24-48a4-4d74-808b-3bc3ebdbec46 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:29.988124 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-8ebc9a24-48a4-4d74-808b-3bc3ebdbec46 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043338 Aug 17 07:33:29.988666 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 404/806] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:33:29 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:31.000861 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0f144215-c679-462a-9b2b-f4f96844640d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:31.003104 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0f144215-c679-462a-9b2b-f4f96844640d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:31.009505 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0f144215-c679-462a-9b2b-f4f96844640d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:31.010010 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0f144215-c679-462a-9b2b-f4f96844640d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:31.010439 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0f144215-c679-462a-9b2b-f4f96844640d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:31.011222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0f144215-c679-462a-9b2b-f4f96844640d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:31.011665 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0f144215-c679-462a-9b2b-f4f96844640d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:31.012080 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0f144215-c679-462a-9b2b-f4f96844640d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:31.041300 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0f144215-c679-462a-9b2b-f4f96844640d tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044469 Aug 17 07:33:31.041852 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 403/807] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:33:30 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:31.618689 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-23bc6e6a-e043-43fd-82c9-2ffc2aa9d5b7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:31.620792 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-23bc6e6a-e043-43fd-82c9-2ffc2aa9d5b7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:31.627089 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-23bc6e6a-e043-43fd-82c9-2ffc2aa9d5b7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:31.628052 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-23bc6e6a-e043-43fd-82c9-2ffc2aa9d5b7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:31.628493 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-23bc6e6a-e043-43fd-82c9-2ffc2aa9d5b7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:31.629176 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-23bc6e6a-e043-43fd-82c9-2ffc2aa9d5b7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:31.629623 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-23bc6e6a-e043-43fd-82c9-2ffc2aa9d5b7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:31.630074 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-23bc6e6a-e043-43fd-82c9-2ffc2aa9d5b7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:31.658335 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-23bc6e6a-e043-43fd-82c9-2ffc2aa9d5b7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043710 Aug 17 07:33:31.659110 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 405/808] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:33:31 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:31.669286 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ae61d566-e57f-45be-b688-c5d4f79bb89f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:31.669776 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ae61d566-e57f-45be-b688-c5d4f79bb89f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:31.675613 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ae61d566-e57f-45be-b688-c5d4f79bb89f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:31.676089 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ae61d566-e57f-45be-b688-c5d4f79bb89f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:31.676523 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ae61d566-e57f-45be-b688-c5d4f79bb89f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:31.677209 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ae61d566-e57f-45be-b688-c5d4f79bb89f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:31.677653 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ae61d566-e57f-45be-b688-c5d4f79bb89f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:31.678107 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ae61d566-e57f-45be-b688-c5d4f79bb89f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:31.705638 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ae61d566-e57f-45be-b688-c5d4f79bb89f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments/46cccf47-d476-4608-a413-07391ed75075" status: 200 len: 194 microversion: 2.1 time: 0.040308 Aug 17 07:33:31.706811 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 404/809] 10.222.0.45 () {58 vars in 1413 bytes} [Wed Aug 17 07:33:31 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments/46cccf47-d476-4608-a413-07391ed75075 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:32.054141 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-b7188fef-e1c7-49c2-bce6-79580c4e6dd0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:32.056208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-b7188fef-e1c7-49c2-bce6-79580c4e6dd0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:32.062021 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b7188fef-e1c7-49c2-bce6-79580c4e6dd0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:32.062505 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b7188fef-e1c7-49c2-bce6-79580c4e6dd0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:32.062942 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b7188fef-e1c7-49c2-bce6-79580c4e6dd0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:32.063641 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b7188fef-e1c7-49c2-bce6-79580c4e6dd0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:32.064073 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b7188fef-e1c7-49c2-bce6-79580c4e6dd0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:32.064515 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-b7188fef-e1c7-49c2-bce6-79580c4e6dd0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:32.092901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-b7188fef-e1c7-49c2-bce6-79580c4e6dd0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043327 Aug 17 07:33:32.093436 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 406/810] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:33:32 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 07:33:32.154227 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-3e9dc585-2ba9-4a96-8516-7d3e00c08dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:32.154725 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-3e9dc585-2ba9-4a96-8516-7d3e00c08dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:32.161486 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3e9dc585-2ba9-4a96-8516-7d3e00c08dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:32.161988 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3e9dc585-2ba9-4a96-8516-7d3e00c08dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:32.162419 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3e9dc585-2ba9-4a96-8516-7d3e00c08dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:32.163094 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3e9dc585-2ba9-4a96-8516-7d3e00c08dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:32.163536 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3e9dc585-2ba9-4a96-8516-7d3e00c08dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:32.163954 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3e9dc585-2ba9-4a96-8516-7d3e00c08dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:32.188895 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-3e9dc585-2ba9-4a96-8516-7d3e00c08dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Going to try to terminate instance {{(pid=120834) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:33:32.264481 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-3e9dc585-2ba9-4a96-8516-7d3e00c08dcd tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 204 len: 0 microversion: 2.1 time: 0.113710 Aug 17 07:33:32.265127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 405/811] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:33:32 2022] DELETE /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:33:32.273935 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-07f78487-84b2-4516-8e2b-3598f16d2804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:32.274630 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-07f78487-84b2-4516-8e2b-3598f16d2804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:32.280492 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-07f78487-84b2-4516-8e2b-3598f16d2804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:32.280967 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-07f78487-84b2-4516-8e2b-3598f16d2804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:32.281401 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-07f78487-84b2-4516-8e2b-3598f16d2804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:32.282124 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-07f78487-84b2-4516-8e2b-3598f16d2804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:32.282574 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-07f78487-84b2-4516-8e2b-3598f16d2804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:32.282996 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-07f78487-84b2-4516-8e2b-3598f16d2804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:32.418808 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-07f78487-84b2-4516-8e2b-3598f16d2804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:32.427002 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-07f78487-84b2-4516-8e2b-3598f16d2804 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 200 len: 1683 microversion: 2.1 time: 0.156947 Aug 17 07:33:32.427573 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 407/812] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:33:32 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:33:33.021477 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-3e0c3df9-4b76-402c-a916-d8c2d1d126e1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9718aa54-609c-46b3-a2d2-97c2784fc13c"}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:33:33.023889 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-3e0c3df9-4b76-402c-a916-d8c2d1d126e1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:33.029732 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3e0c3df9-4b76-402c-a916-d8c2d1d126e1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:33.030251 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3e0c3df9-4b76-402c-a916-d8c2d1d126e1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:33.030687 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3e0c3df9-4b76-402c-a916-d8c2d1d126e1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:33.031365 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3e0c3df9-4b76-402c-a916-d8c2d1d126e1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:33.031817 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3e0c3df9-4b76-402c-a916-d8c2d1d126e1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:33.032235 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3e0c3df9-4b76-402c-a916-d8c2d1d126e1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:33.447903 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ab96e6f5-dc23-4855-b9d9-9ae621cbf50e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:33.448521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-ab96e6f5-dc23-4855-b9d9-9ae621cbf50e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:33.455126 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ab96e6f5-dc23-4855-b9d9-9ae621cbf50e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:33.455608 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ab96e6f5-dc23-4855-b9d9-9ae621cbf50e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:33.456046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ab96e6f5-dc23-4855-b9d9-9ae621cbf50e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:33.456730 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ab96e6f5-dc23-4855-b9d9-9ae621cbf50e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:33.457185 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ab96e6f5-dc23-4855-b9d9-9ae621cbf50e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:33.457610 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ab96e6f5-dc23-4855-b9d9-9ae621cbf50e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:33.735104 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ab96e6f5-dc23-4855-b9d9-9ae621cbf50e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:33.743550 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-ab96e6f5-dc23-4855-b9d9-9ae621cbf50e tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 200 len: 1683 microversion: 2.1 time: 0.299518 Aug 17 07:33:33.744125 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 408/813] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:33:33 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 1683 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:33:33.885988 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-3e0c3df9-4b76-402c-a916-d8c2d1d126e1 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "POST /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.869238 Aug 17 07:33:33.886677 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 406/814] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 17 07:33:33 2022] POST /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments => generated 194 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:34.765587 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-dfd52d4d-0d95-44c8-a18d-9fe5ed2c6e42 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:34.766228 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-dfd52d4d-0d95-44c8-a18d-9fe5ed2c6e42 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:34.772647 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dfd52d4d-0d95-44c8-a18d-9fe5ed2c6e42 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:34.773126 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dfd52d4d-0d95-44c8-a18d-9fe5ed2c6e42 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:34.773569 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dfd52d4d-0d95-44c8-a18d-9fe5ed2c6e42 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:34.774290 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dfd52d4d-0d95-44c8-a18d-9fe5ed2c6e42 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:34.774748 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dfd52d4d-0d95-44c8-a18d-9fe5ed2c6e42 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:34.775177 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dfd52d4d-0d95-44c8-a18d-9fe5ed2c6e42 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:34.919274 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-dfd52d4d-0d95-44c8-a18d-9fe5ed2c6e42 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0c96c80db4db4a477a1fa6c1fa4db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:34.927583 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-dfd52d4d-0d95-44c8-a18d-9fe5ed2c6e42 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 200 len: 1683 microversion: 2.1 time: 0.165859 Aug 17 07:33:34.928149 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 409/815] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:33:34 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:33:35.155564 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-31550ca6-6235-45b7-b641-f94bced0c6a1 req-4a5ad00d-7d91-41e9-8154-7471ba33580d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7dc7f93-7079-4b42-a379-f28a28546aaa", "name": "network-vif-deleted", "tag": "40775ac5-a507-4994-a119-9ac097c452e5"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:33:35.174172 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-31550ca6-6235-45b7-b641-f94bced0c6a1 req-4a5ad00d-7d91-41e9-8154-7471ba33580d service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:35.175953 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-31550ca6-6235-45b7-b641-f94bced0c6a1 req-4a5ad00d-7d91-41e9-8154-7471ba33580d service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:35.176728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-31550ca6-6235-45b7-b641-f94bced0c6a1 req-4a5ad00d-7d91-41e9-8154-7471ba33580d service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:35.188727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-31550ca6-6235-45b7-b641-f94bced0c6a1 req-4a5ad00d-7d91-41e9-8154-7471ba33580d service nova] Creating event network-vif-deleted:40775ac5-a507-4994-a119-9ac097c452e5 for instance f7dc7f93-7079-4b42-a379-f28a28546aaa on hv-cinder-85312 Aug 17 07:33:35.194817 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-31550ca6-6235-45b7-b641-f94bced0c6a1 req-4a5ad00d-7d91-41e9-8154-7471ba33580d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042912 Aug 17 07:33:35.195403 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 407/816] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:35.949286 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9c873f7f-7388-4784-ade5-123e3cf6d6f0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:35.949941 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-9c873f7f-7388-4784-ade5-123e3cf6d6f0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:35.957232 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9c873f7f-7388-4784-ade5-123e3cf6d6f0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:35.957715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9c873f7f-7388-4784-ade5-123e3cf6d6f0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:35.958298 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9c873f7f-7388-4784-ade5-123e3cf6d6f0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:35.959072 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9c873f7f-7388-4784-ade5-123e3cf6d6f0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:35.959524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9c873f7f-7388-4784-ade5-123e3cf6d6f0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:35.959947 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9c873f7f-7388-4784-ade5-123e3cf6d6f0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:35.973758 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-9c873f7f-7388-4784-ade5-123e3cf6d6f0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] HTTP exception thrown: Instance f7dc7f93-7079-4b42-a379-f28a28546aaa could not be found. Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9c873f7f-7388-4784-ade5-123e3cf6d6f0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Request method failure captured: Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa HTTP/1.1 Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JhGMmtOHPQ5tXMBLT1ZWRDn92BoL8xS5HEV9kJ9w-VnlQw7GKIuWmct0Qgt_en_280xO3qINH5E37EeabHnDI9eZ1ASkmK0KnVQ204joQi6gbsZ95MMAexn68sEvntVaw9I7_UKoZlfQdjEqiEYm3qsshCMucpzh5z8w4kUhehd2Ow Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:33:35.975444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:33:35.977150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}] Aug 17 07:33:35.977150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:35.977150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:33:35.977150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:35.977150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:33:35.977150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:33:35.977150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:33:35.977150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: f8b0c96c80db4db4a477a1fa6c1fa4db Aug 17 07:33:35.977150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:33:35.977150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:33:35.977150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance f7dc7f93-7079-4b42-a379-f28a28546aaa could not be found. Aug 17 07:33:35.977150 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': 'f7dc7f93-7079-4b42-a379-f28a28546aaa'} Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7dc7f93-7079-4b42-a379-f28a28546aaa could not be found. Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:33:35.978738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:33:35.980484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:33:35.980484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:33:35.980484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:33:35.980484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:33:35.980484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:33:35.980484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:33:35.980484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:33:35.980484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7dc7f93-7079-4b42-a379-f28a28546aaa could not be found. Aug 17 07:33:35.980484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:35.980484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:35.980484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:35.980484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:35.980484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:35.980484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:35.980484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:33:35.980484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:33:35.980484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7dc7f93-7079-4b42-a379-f28a28546aaa could not be found. Aug 17 07:33:35.980484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:35.981940 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9c873f7f-7388-4784-ade5-123e3cf6d6f0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Returning 404 to user: Instance f7dc7f93-7079-4b42-a379-f28a28546aaa could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:33:35.981940 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-9c873f7f-7388-4784-ade5-123e3cf6d6f0 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 404 len: 111 microversion: 2.1 time: 0.032015 Aug 17 07:33:35.981940 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 410/817] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:33:35 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:33:35.986915 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-cede6864-b69b-497d-ad8c-ea66e9f3d06b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '.version_select at 0x7f30ac2888b0>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:36.008203 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-cede6864-b69b-497d-ad8c-ea66e9f3d06b tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-376869256" status: 202 len: 0 microversion: 2.1 time: 0.025427 Aug 17 07:33:36.009074 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 408/818] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Aug 17 07:33:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-376869256 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:33:37.747831 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2c97d2f3-6222-4af9-b775-64d969fa5880 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:37.748327 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-2c97d2f3-6222-4af9-b775-64d969fa5880 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:37.755493 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2c97d2f3-6222-4af9-b775-64d969fa5880 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:37.755977 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2c97d2f3-6222-4af9-b775-64d969fa5880 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:37.756414 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2c97d2f3-6222-4af9-b775-64d969fa5880 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:37.757132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2c97d2f3-6222-4af9-b775-64d969fa5880 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:37.757590 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2c97d2f3-6222-4af9-b775-64d969fa5880 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:37.758050 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2c97d2f3-6222-4af9-b775-64d969fa5880 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:37.771239 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-2c97d2f3-6222-4af9-b775-64d969fa5880 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] HTTP exception thrown: Instance f7dc7f93-7079-4b42-a379-f28a28546aaa could not be found. Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2c97d2f3-6222-4af9-b775-64d969fa5880 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Request method failure captured: Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: DELETE /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa HTTP/1.1 Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JhGMmtOHPQ5tXMBLT1ZWRDn92BoL8xS5HEV9kJ9w-VnlQw7GKIuWmct0Qgt_en_280xO3qINH5E37EeabHnDI9eZ1ASkmK0KnVQ204joQi6gbsZ95MMAexn68sEvntVaw9I7_UKoZlfQdjEqiEYm3qsshCMucpzh5z8w4kUhehd2Ow Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:33:37.772761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:33:37.774346 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}] Aug 17 07:33:37.774346 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:37.774346 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:33:37.774346 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:37.774346 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:33:37.774346 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:33:37.774346 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:33:37.774346 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: f8b0c96c80db4db4a477a1fa6c1fa4db Aug 17 07:33:37.774346 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:33:37.774346 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:33:37.774346 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance f7dc7f93-7079-4b42-a379-f28a28546aaa could not be found. Aug 17 07:33:37.774346 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': 'f7dc7f93-7079-4b42-a379-f28a28546aaa'} Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7dc7f93-7079-4b42-a379-f28a28546aaa could not be found. Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:33:37.775152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7dc7f93-7079-4b42-a379-f28a28546aaa could not be found. Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7dc7f93-7079-4b42-a379-f28a28546aaa could not be found. Aug 17 07:33:37.776388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:37.777656 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2c97d2f3-6222-4af9-b775-64d969fa5880 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Returning 404 to user: Instance f7dc7f93-7079-4b42-a379-f28a28546aaa could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:33:37.777656 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-2c97d2f3-6222-4af9-b775-64d969fa5880 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 404 len: 111 microversion: 2.1 time: 0.030169 Aug 17 07:33:37.777656 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 411/819] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:33:37 2022] DELETE /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:33:37.782525 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7777cd6e-5796-467a-9aec-d0b0450bc6af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:37.783250 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-7777cd6e-5796-467a-9aec-d0b0450bc6af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: f7dc7f93-7079-4b42-a379-f28a28546aaa] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:37.790377 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7777cd6e-5796-467a-9aec-d0b0450bc6af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:37.790861 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7777cd6e-5796-467a-9aec-d0b0450bc6af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:37.791387 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7777cd6e-5796-467a-9aec-d0b0450bc6af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:37.792545 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7777cd6e-5796-467a-9aec-d0b0450bc6af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:37.793001 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7777cd6e-5796-467a-9aec-d0b0450bc6af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:37.793428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7777cd6e-5796-467a-9aec-d0b0450bc6af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:37.806635 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-7777cd6e-5796-467a-9aec-d0b0450bc6af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] HTTP exception thrown: Instance f7dc7f93-7079-4b42-a379-f28a28546aaa could not be found. Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7777cd6e-5796-467a-9aec-d0b0450bc6af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Request method failure captured: Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa HTTP/1.1 Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JhGMmtOHPQ5tXMBLT1ZWRDn92BoL8xS5HEV9kJ9w-VnlQw7GKIuWmct0Qgt_en_280xO3qINH5E37EeabHnDI9eZ1ASkmK0KnVQ204joQi6gbsZ95MMAexn68sEvntVaw9I7_UKoZlfQdjEqiEYm3qsshCMucpzh5z8w4kUhehd2Ow Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:33:37.808226 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:33:37.809727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}] Aug 17 07:33:37.809727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:37.809727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:33:37.809727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:37.809727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:33:37.809727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:33:37.809727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:33:37.809727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: f8b0c96c80db4db4a477a1fa6c1fa4db Aug 17 07:33:37.809727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:33:37.809727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:33:37.809727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance f7dc7f93-7079-4b42-a379-f28a28546aaa could not be found. Aug 17 07:33:37.809727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': 'f7dc7f93-7079-4b42-a379-f28a28546aaa'} Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7dc7f93-7079-4b42-a379-f28a28546aaa could not be found. Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:33:37.810578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:33:37.811807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:33:37.811807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:33:37.811807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:33:37.811807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:33:37.811807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:33:37.811807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:33:37.811807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:33:37.811807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7dc7f93-7079-4b42-a379-f28a28546aaa could not be found. Aug 17 07:33:37.811807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:37.811807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:37.811807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:37.811807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:37.811807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:37.811807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:37.811807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:33:37.811807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:33:37.811807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7dc7f93-7079-4b42-a379-f28a28546aaa could not be found. Aug 17 07:33:37.811807 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:37.813215 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7777cd6e-5796-467a-9aec-d0b0450bc6af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Returning 404 to user: Instance f7dc7f93-7079-4b42-a379-f28a28546aaa could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:33:37.813215 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-7777cd6e-5796-467a-9aec-d0b0450bc6af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa" status: 404 len: 111 microversion: 2.1 time: 0.030883 Aug 17 07:33:37.813215 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 409/820] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:33:37 2022] GET /compute/v2.1/servers/f7dc7f93-7079-4b42-a379-f28a28546aaa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 07:33:38.944068 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-44a295b1-869b-44a3-9c70-e464a142fbd9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:38.944595 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-44a295b1-869b-44a3-9c70-e464a142fbd9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:38.947001 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=30 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:38.952325 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-44a295b1-869b-44a3-9c70-e464a142fbd9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:38.952794 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-44a295b1-869b-44a3-9c70-e464a142fbd9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:38.953222 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-44a295b1-869b-44a3-9c70-e464a142fbd9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:38.953896 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-44a295b1-869b-44a3-9c70-e464a142fbd9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:38.954371 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-44a295b1-869b-44a3-9c70-e464a142fbd9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:38.954789 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-44a295b1-869b-44a3-9c70-e464a142fbd9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:38.968627 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-44a295b1-869b-44a3-9c70-e464a142fbd9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] HTTP exception thrown: Instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b could not be found. Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-44a295b1-869b-44a3-9c70-e464a142fbd9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Request method failure captured: Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: DELETE /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b HTTP/1.1 Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JhGMmtOHPQ5tXMBLT1ZWRDn92BoL8xS5HEV9kJ9w-VnlQw7GKIuWmct0Qgt_en_280xO3qINH5E37EeabHnDI9eZ1ASkmK0KnVQ204joQi6gbsZ95MMAexn68sEvntVaw9I7_UKoZlfQdjEqiEYm3qsshCMucpzh5z8w4kUhehd2Ow Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:33:38.970172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:33:38.971718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}] Aug 17 07:33:38.971718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:38.971718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:33:38.971718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:38.971718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:33:38.971718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:33:38.971718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:33:38.971718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: f8b0c96c80db4db4a477a1fa6c1fa4db Aug 17 07:33:38.971718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:33:38.971718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:33:38.971718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b could not be found. Aug 17 07:33:38.971718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': 'cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b'} Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b could not be found. Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:33:38.972660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b could not be found. Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b could not be found. Aug 17 07:33:38.974140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:38.975785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-44a295b1-869b-44a3-9c70-e464a142fbd9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Returning 404 to user: Instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:33:38.975785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-44a295b1-869b-44a3-9c70-e464a142fbd9 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b" status: 404 len: 111 microversion: 2.1 time: 0.031831 Aug 17 07:33:38.975785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 412/821] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:33:38 2022] DELETE /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:33:38.980084 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-6d10503b-e789-4695-9607-763a31f691af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:38.980694 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-6d10503b-e789-4695-9607-763a31f691af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:38.987084 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6d10503b-e789-4695-9607-763a31f691af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:38.987561 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6d10503b-e789-4695-9607-763a31f691af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:38.987993 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6d10503b-e789-4695-9607-763a31f691af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:38.988680 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6d10503b-e789-4695-9607-763a31f691af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:38.989129 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6d10503b-e789-4695-9607-763a31f691af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:38.989548 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6d10503b-e789-4695-9607-763a31f691af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:39.003242 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-6d10503b-e789-4695-9607-763a31f691af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] HTTP exception thrown: Instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b could not be found. Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-6d10503b-e789-4695-9607-763a31f691af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Request method failure captured: Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b HTTP/1.1 Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JhGMmtOHPQ5tXMBLT1ZWRDn92BoL8xS5HEV9kJ9w-VnlQw7GKIuWmct0Qgt_en_280xO3qINH5E37EeabHnDI9eZ1ASkmK0KnVQ204joQi6gbsZ95MMAexn68sEvntVaw9I7_UKoZlfQdjEqiEYm3qsshCMucpzh5z8w4kUhehd2Ow Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:33:39.004728 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:33:39.006387 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}] Aug 17 07:33:39.006387 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:39.006387 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:33:39.006387 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:39.006387 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:33:39.006387 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:33:39.006387 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:33:39.006387 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: f8b0c96c80db4db4a477a1fa6c1fa4db Aug 17 07:33:39.006387 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:33:39.006387 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:33:39.006387 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b could not be found. Aug 17 07:33:39.006387 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': 'cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b'} Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b could not be found. Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:33:39.007282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:33:39.008731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:33:39.008731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:33:39.008731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:33:39.008731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:33:39.008731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:33:39.008731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:33:39.008731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:33:39.008731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b could not be found. Aug 17 07:33:39.008731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:39.008731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:39.008731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:39.008731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:39.008731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:39.008731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:39.008731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:33:39.008731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:33:39.008731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b could not be found. Aug 17 07:33:39.008731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:39.010120 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-6d10503b-e789-4695-9607-763a31f691af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Returning 404 to user: Instance cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:33:39.010120 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-6d10503b-e789-4695-9607-763a31f691af tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b" status: 404 len: 111 microversion: 2.1 time: 0.029907 Aug 17 07:33:39.010120 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 410/822] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:33:38 2022] GET /compute/v2.1/servers/cf1f07e2-ec85-44cb-b8ab-7f9f7e1c236b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:33:39.014291 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3597c23a-c913-4b54-ad08-c561a8318f65 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:39.014813 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-3597c23a-c913-4b54-ad08-c561a8318f65 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:39.021261 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3597c23a-c913-4b54-ad08-c561a8318f65 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:39.021732 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3597c23a-c913-4b54-ad08-c561a8318f65 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:39.022190 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3597c23a-c913-4b54-ad08-c561a8318f65 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:39.022866 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3597c23a-c913-4b54-ad08-c561a8318f65 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:39.023311 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3597c23a-c913-4b54-ad08-c561a8318f65 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:39.023755 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3597c23a-c913-4b54-ad08-c561a8318f65 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:39.036587 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-3597c23a-c913-4b54-ad08-c561a8318f65 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] HTTP exception thrown: Instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 could not be found. Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3597c23a-c913-4b54-ad08-c561a8318f65 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Request method failure captured: Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: DELETE /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 HTTP/1.1 Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JhGMmtOHPQ5tXMBLT1ZWRDn92BoL8xS5HEV9kJ9w-VnlQw7GKIuWmct0Qgt_en_280xO3qINH5E37EeabHnDI9eZ1ASkmK0KnVQ204joQi6gbsZ95MMAexn68sEvntVaw9I7_UKoZlfQdjEqiEYm3qsshCMucpzh5z8w4kUhehd2Ow Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:33:39.038103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:33:39.039773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}] Aug 17 07:33:39.039773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:39.039773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:33:39.039773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:39.039773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:33:39.039773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:33:39.039773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:33:39.039773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: f8b0c96c80db4db4a477a1fa6c1fa4db Aug 17 07:33:39.039773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:33:39.039773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:33:39.039773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 could not be found. Aug 17 07:33:39.039773 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': 'ebe690bb-f5a6-4080-aad0-4e79bf213d27'} Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 could not be found. Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:33:39.040646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 could not be found. Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 could not be found. Aug 17 07:33:39.042223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:39.043654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3597c23a-c913-4b54-ad08-c561a8318f65 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Returning 404 to user: Instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:33:39.043654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-3597c23a-c913-4b54-ad08-c561a8318f65 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 404 len: 111 microversion: 2.1 time: 0.028910 Aug 17 07:33:39.043654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 413/823] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:33:39 2022] DELETE /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:33:39.047446 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f1e723f0-13a7-4109-97ea-7135fc1a14cb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:39.048042 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f1e723f0-13a7-4109-97ea-7135fc1a14cb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: ebe690bb-f5a6-4080-aad0-4e79bf213d27] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:39.054154 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f1e723f0-13a7-4109-97ea-7135fc1a14cb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:39.054627 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f1e723f0-13a7-4109-97ea-7135fc1a14cb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:39.055058 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f1e723f0-13a7-4109-97ea-7135fc1a14cb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:39.055733 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f1e723f0-13a7-4109-97ea-7135fc1a14cb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:39.056179 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f1e723f0-13a7-4109-97ea-7135fc1a14cb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:39.056596 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f1e723f0-13a7-4109-97ea-7135fc1a14cb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:39.070197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-f1e723f0-13a7-4109-97ea-7135fc1a14cb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] HTTP exception thrown: Instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 could not be found. Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f1e723f0-13a7-4109-97ea-7135fc1a14cb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Request method failure captured: Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 HTTP/1.1 Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JhGMmtOHPQ5tXMBLT1ZWRDn92BoL8xS5HEV9kJ9w-VnlQw7GKIuWmct0Qgt_en_280xO3qINH5E37EeabHnDI9eZ1ASkmK0KnVQ204joQi6gbsZ95MMAexn68sEvntVaw9I7_UKoZlfQdjEqiEYm3qsshCMucpzh5z8w4kUhehd2Ow Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:33:39.071709 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:33:39.073222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}] Aug 17 07:33:39.073222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:39.073222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:33:39.073222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:39.073222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:33:39.073222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:33:39.073222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:33:39.073222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: f8b0c96c80db4db4a477a1fa6c1fa4db Aug 17 07:33:39.073222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:33:39.073222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:33:39.073222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 could not be found. Aug 17 07:33:39.073222 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': 'ebe690bb-f5a6-4080-aad0-4e79bf213d27'} Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 could not be found. Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:33:39.074236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:33:39.075875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:33:39.075875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:33:39.075875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:33:39.075875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:33:39.075875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:33:39.075875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:33:39.075875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:33:39.075875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 could not be found. Aug 17 07:33:39.075875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:39.075875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:39.075875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:39.075875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:39.075875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:39.075875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:39.075875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:33:39.075875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:33:39.075875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 could not be found. Aug 17 07:33:39.075875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:39.077341 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f1e723f0-13a7-4109-97ea-7135fc1a14cb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Returning 404 to user: Instance ebe690bb-f5a6-4080-aad0-4e79bf213d27 could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:33:39.077341 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f1e723f0-13a7-4109-97ea-7135fc1a14cb tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27" status: 404 len: 111 microversion: 2.1 time: 0.029303 Aug 17 07:33:39.077341 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 411/824] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:33:39 2022] GET /compute/v2.1/servers/ebe690bb-f5a6-4080-aad0-4e79bf213d27 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:33:40.213078 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-64b6c311-dae8-4d1f-858f-c86ccc1950ef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:40.213577 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-64b6c311-dae8-4d1f-858f-c86ccc1950ef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:40.219917 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-64b6c311-dae8-4d1f-858f-c86ccc1950ef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:40.220380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-64b6c311-dae8-4d1f-858f-c86ccc1950ef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:40.220807 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-64b6c311-dae8-4d1f-858f-c86ccc1950ef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:40.222092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-64b6c311-dae8-4d1f-858f-c86ccc1950ef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:40.222573 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-64b6c311-dae8-4d1f-858f-c86ccc1950ef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:40.222997 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-64b6c311-dae8-4d1f-858f-c86ccc1950ef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:40.236136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-64b6c311-dae8-4d1f-858f-c86ccc1950ef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] HTTP exception thrown: Instance 15365fa0-3501-49cd-a3d5-9ac53d13169f could not be found. Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-64b6c311-dae8-4d1f-858f-c86ccc1950ef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Request method failure captured: Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: DELETE /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f HTTP/1.1 Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JhGMmtOHPQ5tXMBLT1ZWRDn92BoL8xS5HEV9kJ9w-VnlQw7GKIuWmct0Qgt_en_280xO3qINH5E37EeabHnDI9eZ1ASkmK0KnVQ204joQi6gbsZ95MMAexn68sEvntVaw9I7_UKoZlfQdjEqiEYm3qsshCMucpzh5z8w4kUhehd2Ow Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:33:40.237538 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:33:40.239048 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}] Aug 17 07:33:40.239048 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:40.239048 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:33:40.239048 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:40.239048 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:33:40.239048 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:33:40.239048 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:33:40.239048 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: f8b0c96c80db4db4a477a1fa6c1fa4db Aug 17 07:33:40.239048 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:33:40.239048 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:33:40.239048 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance 15365fa0-3501-49cd-a3d5-9ac53d13169f could not be found. Aug 17 07:33:40.239048 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': '15365fa0-3501-49cd-a3d5-9ac53d13169f'} Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15365fa0-3501-49cd-a3d5-9ac53d13169f could not be found. Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:33:40.239929 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15365fa0-3501-49cd-a3d5-9ac53d13169f could not be found. Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15365fa0-3501-49cd-a3d5-9ac53d13169f could not be found. Aug 17 07:33:40.241380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:40.243637 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-64b6c311-dae8-4d1f-858f-c86ccc1950ef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Returning 404 to user: Instance 15365fa0-3501-49cd-a3d5-9ac53d13169f could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:33:40.243637 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-64b6c311-dae8-4d1f-858f-c86ccc1950ef tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "DELETE /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 404 len: 111 microversion: 2.1 time: 0.029719 Aug 17 07:33:40.243637 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 414/825] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:33:40 2022] DELETE /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:33:40.248781 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7d526a84-bd24-46db-a605-f6609f023134 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:40.249390 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-7d526a84-bd24-46db-a605-f6609f023134 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] [instance: 15365fa0-3501-49cd-a3d5-9ac53d13169f] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:40.255705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7d526a84-bd24-46db-a605-f6609f023134 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:40.256182 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7d526a84-bd24-46db-a605-f6609f023134 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:40.256619 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7d526a84-bd24-46db-a605-f6609f023134 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:40.257484 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7d526a84-bd24-46db-a605-f6609f023134 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:40.257742 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7d526a84-bd24-46db-a605-f6609f023134 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:40.258195 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7d526a84-bd24-46db-a605-f6609f023134 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:40.271684 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-7d526a84-bd24-46db-a605-f6609f023134 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] HTTP exception thrown: Instance 15365fa0-3501-49cd-a3d5-9ac53d13169f could not be found. Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7d526a84-bd24-46db-a605-f6609f023134 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Request method failure captured: Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f HTTP/1.1 Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JhGMmtOHPQ5tXMBLT1ZWRDn92BoL8xS5HEV9kJ9w-VnlQw7GKIuWmct0Qgt_en_280xO3qINH5E37EeabHnDI9eZ1ASkmK0KnVQ204joQi6gbsZ95MMAexn68sEvntVaw9I7_UKoZlfQdjEqiEYm3qsshCMucpzh5z8w4kUhehd2Ow Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:33:40.273189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:33:40.274808 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/99d9a3fa9369495ab6d8da88f3d9dbd5"}]}] Aug 17 07:33:40.274808 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:40.274808 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 99d9a3fa9369495ab6d8da88f3d9dbd5 Aug 17 07:33:40.274808 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-747516424 Aug 17 07:33:40.274808 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:33:40.274808 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:33:40.274808 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:33:40.274808 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: f8b0c96c80db4db4a477a1fa6c1fa4db Aug 17 07:33:40.274808 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-AttachVolumeNegativeTest-747516424-project Aug 17 07:33:40.274808 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:33:40.274808 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance 15365fa0-3501-49cd-a3d5-9ac53d13169f could not be found. Aug 17 07:33:40.274808 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': '15365fa0-3501-49cd-a3d5-9ac53d13169f'} Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15365fa0-3501-49cd-a3d5-9ac53d13169f could not be found. Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:33:40.279871 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:33:40.281342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:33:40.281342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:33:40.281342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:33:40.281342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:33:40.281342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:33:40.281342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:33:40.281342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:33:40.281342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15365fa0-3501-49cd-a3d5-9ac53d13169f could not be found. Aug 17 07:33:40.281342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:40.281342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:40.281342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:40.281342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:40.281342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:40.281342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:40.281342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:33:40.281342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:33:40.281342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15365fa0-3501-49cd-a3d5-9ac53d13169f could not be found. Aug 17 07:33:40.281342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:40.282661 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7d526a84-bd24-46db-a605-f6609f023134 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] Returning 404 to user: Instance 15365fa0-3501-49cd-a3d5-9ac53d13169f could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:33:40.282661 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-7d526a84-bd24-46db-a605-f6609f023134 tempest-AttachVolumeNegativeTest-747516424 tempest-AttachVolumeNegativeTest-747516424-project] 10.222.0.45 "GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f" status: 404 len: 111 microversion: 2.1 time: 0.029604 Aug 17 07:33:40.282661 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 412/826] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:33:40 2022] GET /compute/v2.1/servers/15365fa0-3501-49cd-a3d5-9ac53d13169f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:33:41.430949 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d4195538-8808-4b5b-8a7f-37cf2b3f685e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:41.433273 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d4195538-8808-4b5b-8a7f-37cf2b3f685e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:41.440023 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d4195538-8808-4b5b-8a7f-37cf2b3f685e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:41.440909 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d4195538-8808-4b5b-8a7f-37cf2b3f685e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:41.441774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d4195538-8808-4b5b-8a7f-37cf2b3f685e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:41.442523 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d4195538-8808-4b5b-8a7f-37cf2b3f685e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:41.442979 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d4195538-8808-4b5b-8a7f-37cf2b3f685e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:41.443408 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d4195538-8808-4b5b-8a7f-37cf2b3f685e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:41.474525 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d4195538-8808-4b5b-8a7f-37cf2b3f685e tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047578 Aug 17 07:33:41.475274 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 415/827] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:33:41 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:41.615496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0887ae92-b102-4e29-8306-ad729b710c84 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:41.616030 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0887ae92-b102-4e29-8306-ad729b710c84 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:41.622514 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0887ae92-b102-4e29-8306-ad729b710c84 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:41.622987 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0887ae92-b102-4e29-8306-ad729b710c84 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:41.623413 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0887ae92-b102-4e29-8306-ad729b710c84 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:41.624094 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0887ae92-b102-4e29-8306-ad729b710c84 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:41.624536 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0887ae92-b102-4e29-8306-ad729b710c84 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:41.624952 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0887ae92-b102-4e29-8306-ad729b710c84 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:41.653378 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0887ae92-b102-4e29-8306-ad729b710c84 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments/46cccf47-d476-4608-a413-07391ed75075" status: 200 len: 194 microversion: 2.1 time: 0.041863 Aug 17 07:33:41.653883 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 413/828] 10.222.0.45 () {58 vars in 1413 bytes} [Wed Aug 17 07:33:41 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments/46cccf47-d476-4608-a413-07391ed75075 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:41.664501 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-07e4f053-7819-4155-a6e8-e7416d190c2c tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:41.664993 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-07e4f053-7819-4155-a6e8-e7416d190c2c tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:41.670819 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-07e4f053-7819-4155-a6e8-e7416d190c2c tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:41.671297 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-07e4f053-7819-4155-a6e8-e7416d190c2c tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:41.671730 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-07e4f053-7819-4155-a6e8-e7416d190c2c tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:41.672412 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-07e4f053-7819-4155-a6e8-e7416d190c2c tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:41.672863 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-07e4f053-7819-4155-a6e8-e7416d190c2c tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:41.673314 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-07e4f053-7819-4155-a6e8-e7416d190c2c tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:41.752648 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.objects.instance [None req-07e4f053-7819-4155-a6e8-e7416d190c2c tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lazy-loading 'services' on Instance uuid 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 {{(pid=120835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:33:41.817727 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:41.833289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-07e4f053-7819-4155-a6e8-e7416d190c2c tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments/46cccf47-d476-4608-a413-07391ed75075" status: 202 len: 0 microversion: 2.1 time: 0.172396 Aug 17 07:33:41.834137 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 416/829] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 17 07:33:41 2022] DELETE /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments/46cccf47-d476-4608-a413-07391ed75075 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 07:33:42.973464 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-2d8eb34f-7d09-4502-87ab-2ae442436aa5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:42.973984 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-2d8eb34f-7d09-4502-87ab-2ae442436aa5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:42.980976 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2d8eb34f-7d09-4502-87ab-2ae442436aa5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:42.981454 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2d8eb34f-7d09-4502-87ab-2ae442436aa5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:42.981915 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2d8eb34f-7d09-4502-87ab-2ae442436aa5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:42.982634 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2d8eb34f-7d09-4502-87ab-2ae442436aa5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:42.983600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2d8eb34f-7d09-4502-87ab-2ae442436aa5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:42.984014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2d8eb34f-7d09-4502-87ab-2ae442436aa5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:43.014076 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-2d8eb34f-7d09-4502-87ab-2ae442436aa5 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments/9718aa54-609c-46b3-a2d2-97c2784fc13c" status: 200 len: 194 microversion: 2.1 time: 0.044661 Aug 17 07:33:43.014656 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 414/830] 10.222.0.45 () {58 vars in 1413 bytes} [Wed Aug 17 07:33:42 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments/9718aa54-609c-46b3-a2d2-97c2784fc13c => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:43.026619 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-9994adf0-3b2d-4dd9-83cd-12595f31f696 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:43.027203 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-9994adf0-3b2d-4dd9-83cd-12595f31f696 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:43.033687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9994adf0-3b2d-4dd9-83cd-12595f31f696 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:43.034203 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9994adf0-3b2d-4dd9-83cd-12595f31f696 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:43.034643 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9994adf0-3b2d-4dd9-83cd-12595f31f696 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:43.035337 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9994adf0-3b2d-4dd9-83cd-12595f31f696 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:43.035787 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9994adf0-3b2d-4dd9-83cd-12595f31f696 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:43.036247 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-9994adf0-3b2d-4dd9-83cd-12595f31f696 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:43.116572 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.objects.instance [None req-9994adf0-3b2d-4dd9-83cd-12595f31f696 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lazy-loading 'services' on Instance uuid 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 {{(pid=120835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:33:43.198306 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-9994adf0-3b2d-4dd9-83cd-12595f31f696 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments/9718aa54-609c-46b3-a2d2-97c2784fc13c" status: 202 len: 0 microversion: 2.1 time: 0.176598 Aug 17 07:33:43.199271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 417/831] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 17 07:33:43 2022] DELETE /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments/9718aa54-609c-46b3-a2d2-97c2784fc13c => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:33:44.402549 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-72351505-b05d-451a-9660-857c75543f92 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:44.404712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-72351505-b05d-451a-9660-857c75543f92 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:44.411095 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-72351505-b05d-451a-9660-857c75543f92 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:44.411577 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-72351505-b05d-451a-9660-857c75543f92 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:44.412011 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-72351505-b05d-451a-9660-857c75543f92 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:44.412707 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-72351505-b05d-451a-9660-857c75543f92 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:44.413161 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-72351505-b05d-451a-9660-857c75543f92 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:44.413594 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-72351505-b05d-451a-9660-857c75543f92 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:44.442409 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-72351505-b05d-451a-9660-857c75543f92 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043710 Aug 17 07:33:44.443244 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 415/832] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:33:44 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 07:33:44.568235 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-106bc9ca-0353-4895-8961-3f3d6246a9b9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:44.571132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-106bc9ca-0353-4895-8961-3f3d6246a9b9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:44.577358 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-106bc9ca-0353-4895-8961-3f3d6246a9b9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:44.577713 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-106bc9ca-0353-4895-8961-3f3d6246a9b9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:44.578174 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-106bc9ca-0353-4895-8961-3f3d6246a9b9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:44.578861 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-106bc9ca-0353-4895-8961-3f3d6246a9b9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:44.579307 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-106bc9ca-0353-4895-8961-3f3d6246a9b9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:44.579736 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-106bc9ca-0353-4895-8961-3f3d6246a9b9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:44.608659 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-106bc9ca-0353-4895-8961-3f3d6246a9b9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045686 Aug 17 07:33:44.615280 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 418/833] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 17 07:33:44 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 07:33:44.676475 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-71e21d74-1c19-4272-9551-a1e0411c44ab tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:44.677057 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-71e21d74-1c19-4272-9551-a1e0411c44ab tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:44.683395 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-71e21d74-1c19-4272-9551-a1e0411c44ab tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:44.683851 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-71e21d74-1c19-4272-9551-a1e0411c44ab tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:44.684290 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-71e21d74-1c19-4272-9551-a1e0411c44ab tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:44.684983 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-71e21d74-1c19-4272-9551-a1e0411c44ab tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:44.685436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-71e21d74-1c19-4272-9551-a1e0411c44ab tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:44.685865 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-71e21d74-1c19-4272-9551-a1e0411c44ab tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:44.712793 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-71e21d74-1c19-4272-9551-a1e0411c44ab tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Going to try to terminate instance {{(pid=120834) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:33:44.714739 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:44.792199 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-71e21d74-1c19-4272-9551-a1e0411c44ab tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325" status: 204 len: 0 microversion: 2.1 time: 0.120491 Aug 17 07:33:44.792776 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 416/834] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:33:44 2022] DELETE /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:33:44.803392 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-60f071a3-2a76-4730-9295-f3d9986189b6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:44.804008 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-60f071a3-2a76-4730-9295-f3d9986189b6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:44.810152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-60f071a3-2a76-4730-9295-f3d9986189b6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:44.810638 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-60f071a3-2a76-4730-9295-f3d9986189b6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:44.811073 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-60f071a3-2a76-4730-9295-f3d9986189b6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:44.811772 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-60f071a3-2a76-4730-9295-f3d9986189b6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:44.812228 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-60f071a3-2a76-4730-9295-f3d9986189b6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:44.812655 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-60f071a3-2a76-4730-9295-f3d9986189b6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:44.948883 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-60f071a3-2a76-4730-9295-f3d9986189b6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:44.956427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-60f071a3-2a76-4730-9295-f3d9986189b6 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325" status: 200 len: 1671 microversion: 2.1 time: 0.159108 Aug 17 07:33:44.956989 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 419/835] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:33:44 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:33:45.977690 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-8f8fa860-ac49-4810-9b39-a25ef6075be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:45.978568 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-8f8fa860-ac49-4810-9b39-a25ef6075be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:45.984905 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8f8fa860-ac49-4810-9b39-a25ef6075be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:45.985386 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8f8fa860-ac49-4810-9b39-a25ef6075be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:45.985866 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8f8fa860-ac49-4810-9b39-a25ef6075be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:45.987247 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8f8fa860-ac49-4810-9b39-a25ef6075be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:45.987698 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8f8fa860-ac49-4810-9b39-a25ef6075be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:45.988117 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8f8fa860-ac49-4810-9b39-a25ef6075be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:46.402518 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-8f8fa860-ac49-4810-9b39-a25ef6075be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:46.411605 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-8f8fa860-ac49-4810-9b39-a25ef6075be4 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325" status: 200 len: 1671 microversion: 2.1 time: 0.438170 Aug 17 07:33:46.412555 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 417/836] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:33:45 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 => generated 1671 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:33:47.433696 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d6034db4-f325-4b38-b08d-8615ea14a853 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:47.434334 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d6034db4-f325-4b38-b08d-8615ea14a853 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:47.442149 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d6034db4-f325-4b38-b08d-8615ea14a853 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:47.442918 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d6034db4-f325-4b38-b08d-8615ea14a853 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:47.443355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d6034db4-f325-4b38-b08d-8615ea14a853 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:47.444361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d6034db4-f325-4b38-b08d-8615ea14a853 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:47.444817 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d6034db4-f325-4b38-b08d-8615ea14a853 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:47.445241 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d6034db4-f325-4b38-b08d-8615ea14a853 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:47.519853 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d6034db4-f325-4b38-b08d-8615ea14a853 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11d183b3c0c4b2b83f3b52b881a72cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c491181ae054706be3bdc94c61501f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:47.525823 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d6034db4-f325-4b38-b08d-8615ea14a853 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325" status: 200 len: 1604 microversion: 2.1 time: 0.096894 Aug 17 07:33:47.526426 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 420/837] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:33:47 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 => generated 1604 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:33:47.756058 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-4db1ae32-1429-440e-90d3-4e088290b330 req-f03463a4-5945-48f4-9764-99baf8be6a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325", "name": "network-vif-deleted", "tag": "92cee9b4-b45b-4de3-a2a7-2bfe79574445"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:33:47.761670 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:47.768687 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-4db1ae32-1429-440e-90d3-4e088290b330 req-f03463a4-5945-48f4-9764-99baf8be6a66 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:47.769422 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-4db1ae32-1429-440e-90d3-4e088290b330 req-f03463a4-5945-48f4-9764-99baf8be6a66 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:47.770059 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-4db1ae32-1429-440e-90d3-4e088290b330 req-f03463a4-5945-48f4-9764-99baf8be6a66 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:47.782617 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-4db1ae32-1429-440e-90d3-4e088290b330 req-f03463a4-5945-48f4-9764-99baf8be6a66 service nova] Creating event network-vif-deleted:92cee9b4-b45b-4de3-a2a7-2bfe79574445 for instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 on hv-cinder-85312 Aug 17 07:33:47.788253 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-4db1ae32-1429-440e-90d3-4e088290b330 req-f03463a4-5945-48f4-9764-99baf8be6a66 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036650 Aug 17 07:33:47.792833 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 418/838] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:33:48.547898 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-8ef931f2-c80d-4a35-9afb-b73742b93280 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:48.548462 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-8ef931f2-c80d-4a35-9afb-b73742b93280 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:48.555875 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8ef931f2-c80d-4a35-9afb-b73742b93280 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:48.556362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8ef931f2-c80d-4a35-9afb-b73742b93280 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:48.556802 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8ef931f2-c80d-4a35-9afb-b73742b93280 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:48.557495 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8ef931f2-c80d-4a35-9afb-b73742b93280 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:48.557948 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8ef931f2-c80d-4a35-9afb-b73742b93280 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:48.558389 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8ef931f2-c80d-4a35-9afb-b73742b93280 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:48.573207 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-8ef931f2-c80d-4a35-9afb-b73742b93280 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] HTTP exception thrown: Instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 could not be found. Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-8ef931f2-c80d-4a35-9afb-b73742b93280 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Request method failure captured: Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 HTTP/1.1 Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JhG_obk1inmT-LpGftVC8T_Y8-pPVjLVEglzNX3UWJnFKSaygoEUadJWBB4wc6CY_m1NhNRYkDoN3i_zhO67OseVSYrxfs2pq5bj9nfMx8H5Hjc4Mn1eAzXoC5ol4Ys42C-4fT14ZE_lGe5ULsQ0w7YQ1WfiQ-SVzhswGz_4MT3Z6s Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 3c491181ae054706be3bdc94c61501f9 Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-AttachVolumeTestJSON-1998608911 Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:33:48.574876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:33:48.576379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3c491181ae054706be3bdc94c61501f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3c491181ae054706be3bdc94c61501f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c491181ae054706be3bdc94c61501f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c491181ae054706be3bdc94c61501f9"}]}] Aug 17 07:33:48.576379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-AttachVolumeTestJSON-1998608911 Aug 17 07:33:48.576379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 3c491181ae054706be3bdc94c61501f9 Aug 17 07:33:48.576379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1998608911 Aug 17 07:33:48.576379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-AttachVolumeTestJSON-1998608911-project Aug 17 07:33:48.576379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:33:48.576379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:33:48.576379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: c11d183b3c0c4b2b83f3b52b881a72cf Aug 17 07:33:48.576379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-AttachVolumeTestJSON-1998608911-project Aug 17 07:33:48.576379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:33:48.576379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 could not be found. Aug 17 07:33:48.576379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': '4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325'} Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 could not be found. Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:33:48.577140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:33:48.578403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:33:48.578403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:33:48.578403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:33:48.578403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:33:48.578403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:33:48.578403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:33:48.578403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:33:48.578403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 could not be found. Aug 17 07:33:48.578403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:48.578403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:48.578403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:48.578403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:48.578403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:48.578403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:48.578403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:33:48.578403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:33:48.578403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 could not be found. Aug 17 07:33:48.578403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:48.579524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-8ef931f2-c80d-4a35-9afb-b73742b93280 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Returning 404 to user: Instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:33:48.579524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-8ef931f2-c80d-4a35-9afb-b73742b93280 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325" status: 404 len: 111 microversion: 2.1 time: 0.032347 Aug 17 07:33:48.579524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 421/839] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:33:48 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:33:48.588689 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-18bec520-d6f0-4755-b421-df018cf6d0b9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '.version_select at 0x7f30ac3495e0>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:48.610809 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-18bec520-d6f0-4755-b421-df018cf6d0b9 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-194160104" status: 202 len: 0 microversion: 2.1 time: 0.027070 Aug 17 07:33:48.611927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 419/840] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Aug 17 07:33:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-194160104 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:33:49.834056 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-187a6c94-3fc2-4cc7-9a10-af726800646f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:49.836332 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-187a6c94-3fc2-4cc7-9a10-af726800646f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:49.842652 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-187a6c94-3fc2-4cc7-9a10-af726800646f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:49.843148 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-187a6c94-3fc2-4cc7-9a10-af726800646f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:49.843569 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-187a6c94-3fc2-4cc7-9a10-af726800646f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:49.844258 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-187a6c94-3fc2-4cc7-9a10-af726800646f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:49.844713 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-187a6c94-3fc2-4cc7-9a10-af726800646f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:49.845145 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-187a6c94-3fc2-4cc7-9a10-af726800646f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:49.874578 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-187a6c94-3fc2-4cc7-9a10-af726800646f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044517 Aug 17 07:33:49.875119 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 422/841] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 17 07:33:49 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:33:49.936818 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0cf45698-b6b9-4d58-980a-d11fe4f59fd2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:49.937429 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0cf45698-b6b9-4d58-980a-d11fe4f59fd2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:49.944061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0cf45698-b6b9-4d58-980a-d11fe4f59fd2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:49.944619 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0cf45698-b6b9-4d58-980a-d11fe4f59fd2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:49.945110 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0cf45698-b6b9-4d58-980a-d11fe4f59fd2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:49.946105 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0cf45698-b6b9-4d58-980a-d11fe4f59fd2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:49.946560 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0cf45698-b6b9-4d58-980a-d11fe4f59fd2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:49.946980 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0cf45698-b6b9-4d58-980a-d11fe4f59fd2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:49.975311 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0cf45698-b6b9-4d58-980a-d11fe4f59fd2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Going to try to terminate instance {{(pid=120834) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:33:50.056139 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0cf45698-b6b9-4d58-980a-d11fe4f59fd2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 204 len: 0 microversion: 2.20 time: 0.123333 Aug 17 07:33:50.056929 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 420/842] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 17 07:33:49 2022] DELETE /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 07:33:50.066386 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2f8b0484-f5af-41dc-8546-26496a50faa2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:50.066999 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-2f8b0484-f5af-41dc-8546-26496a50faa2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:50.073257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2f8b0484-f5af-41dc-8546-26496a50faa2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:50.073742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2f8b0484-f5af-41dc-8546-26496a50faa2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:50.074219 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2f8b0484-f5af-41dc-8546-26496a50faa2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:50.074939 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2f8b0484-f5af-41dc-8546-26496a50faa2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:50.075417 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2f8b0484-f5af-41dc-8546-26496a50faa2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:50.075848 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2f8b0484-f5af-41dc-8546-26496a50faa2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:50.201488 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2f8b0484-f5af-41dc-8546-26496a50faa2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:50.209402 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2f8b0484-f5af-41dc-8546-26496a50faa2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:50.210951 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2f8b0484-f5af-41dc-8546-26496a50faa2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:50.212111 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-2f8b0484-f5af-41dc-8546-26496a50faa2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1722 microversion: 2.20 time: 0.150533 Aug 17 07:33:50.212663 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 423/843] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:33:50 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 07:33:51.235464 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-d6269ac3-8546-48ed-9b34-464c43e13ec5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:51.236672 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-d6269ac3-8546-48ed-9b34-464c43e13ec5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:51.243252 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d6269ac3-8546-48ed-9b34-464c43e13ec5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:51.243725 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d6269ac3-8546-48ed-9b34-464c43e13ec5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:51.244156 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d6269ac3-8546-48ed-9b34-464c43e13ec5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:51.244831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d6269ac3-8546-48ed-9b34-464c43e13ec5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:51.245275 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d6269ac3-8546-48ed-9b34-464c43e13ec5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:51.245690 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d6269ac3-8546-48ed-9b34-464c43e13ec5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:51.379793 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-d6269ac3-8546-48ed-9b34-464c43e13ec5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:51.387665 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-d6269ac3-8546-48ed-9b34-464c43e13ec5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:51.389158 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-d6269ac3-8546-48ed-9b34-464c43e13ec5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:51.390356 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-d6269ac3-8546-48ed-9b34-464c43e13ec5 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1722 microversion: 2.20 time: 0.159062 Aug 17 07:33:51.390907 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 421/844] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:33:51 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:33:52.413828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-07c1c338-6c52-4e7f-a052-a39c9bd477eb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:52.414471 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-07c1c338-6c52-4e7f-a052-a39c9bd477eb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:52.421029 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-07c1c338-6c52-4e7f-a052-a39c9bd477eb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:52.421510 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-07c1c338-6c52-4e7f-a052-a39c9bd477eb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:52.421947 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-07c1c338-6c52-4e7f-a052-a39c9bd477eb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:52.422664 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-07c1c338-6c52-4e7f-a052-a39c9bd477eb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:52.423119 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-07c1c338-6c52-4e7f-a052-a39c9bd477eb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:52.423547 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-07c1c338-6c52-4e7f-a052-a39c9bd477eb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:52.551508 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-07c1c338-6c52-4e7f-a052-a39c9bd477eb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:52.559393 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-07c1c338-6c52-4e7f-a052-a39c9bd477eb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:52.560894 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-07c1c338-6c52-4e7f-a052-a39c9bd477eb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:52.562086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-07c1c338-6c52-4e7f-a052-a39c9bd477eb tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1722 microversion: 2.20 time: 0.152128 Aug 17 07:33:52.562639 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 424/845] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:33:52 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:33:53.583836 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-32607d49-0f42-45d9-9d6c-11e333c75548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:53.584482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-32607d49-0f42-45d9-9d6c-11e333c75548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:53.591034 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-32607d49-0f42-45d9-9d6c-11e333c75548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:53.591504 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-32607d49-0f42-45d9-9d6c-11e333c75548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:53.591930 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-32607d49-0f42-45d9-9d6c-11e333c75548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:53.592624 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-32607d49-0f42-45d9-9d6c-11e333c75548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:53.593069 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-32607d49-0f42-45d9-9d6c-11e333c75548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:53.593487 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-32607d49-0f42-45d9-9d6c-11e333c75548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:53.645895 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c7f0f6a8-f504-462f-b27f-594a092c361f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:53.646458 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-c7f0f6a8-f504-462f-b27f-594a092c361f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:53.652946 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c7f0f6a8-f504-462f-b27f-594a092c361f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:53.653660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c7f0f6a8-f504-462f-b27f-594a092c361f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:53.654155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c7f0f6a8-f504-462f-b27f-594a092c361f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:53.655879 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c7f0f6a8-f504-462f-b27f-594a092c361f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:53.656339 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c7f0f6a8-f504-462f-b27f-594a092c361f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:53.656767 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c7f0f6a8-f504-462f-b27f-594a092c361f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:53.670895 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-c7f0f6a8-f504-462f-b27f-594a092c361f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] HTTP exception thrown: Instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 could not be found. Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c7f0f6a8-f504-462f-b27f-594a092c361f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Request method failure captured: Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: DELETE /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 HTTP/1.1 Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JhG_obk1inmT-LpGftVC8T_Y8-pPVjLVEglzNX3UWJnFKSaygoEUadJWBB4wc6CY_m1NhNRYkDoN3i_zhO67OseVSYrxfs2pq5bj9nfMx8H5Hjc4Mn1eAzXoC5ol4Ys42C-4fT14ZE_lGe5ULsQ0w7YQ1WfiQ-SVzhswGz_4MT3Z6s Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 3c491181ae054706be3bdc94c61501f9 Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-AttachVolumeTestJSON-1998608911 Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:33:53.672783 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:33:53.674264 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3c491181ae054706be3bdc94c61501f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3c491181ae054706be3bdc94c61501f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c491181ae054706be3bdc94c61501f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c491181ae054706be3bdc94c61501f9"}]}] Aug 17 07:33:53.674264 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-AttachVolumeTestJSON-1998608911 Aug 17 07:33:53.674264 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 3c491181ae054706be3bdc94c61501f9 Aug 17 07:33:53.674264 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1998608911 Aug 17 07:33:53.674264 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-AttachVolumeTestJSON-1998608911-project Aug 17 07:33:53.674264 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:33:53.674264 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:33:53.674264 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: c11d183b3c0c4b2b83f3b52b881a72cf Aug 17 07:33:53.674264 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-AttachVolumeTestJSON-1998608911-project Aug 17 07:33:53.674264 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:33:53.674264 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 could not be found. Aug 17 07:33:53.674264 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': '4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325'} Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 could not be found. Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:33:53.676132 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 could not be found. Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 could not be found. Aug 17 07:33:53.677400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:53.679812 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c7f0f6a8-f504-462f-b27f-594a092c361f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Returning 404 to user: Instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:33:53.679812 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-c7f0f6a8-f504-462f-b27f-594a092c361f tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325" status: 404 len: 111 microversion: 2.1 time: 0.032214 Aug 17 07:33:53.679812 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 425/846] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:33:53 2022] DELETE /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 07:33:53.682861 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-531b9b32-cc39-4848-a9fb-7afa3777f066 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:53.683475 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-531b9b32-cc39-4848-a9fb-7afa3777f066 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:53.689216 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-531b9b32-cc39-4848-a9fb-7afa3777f066 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:53.689892 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-531b9b32-cc39-4848-a9fb-7afa3777f066 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:53.690381 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-531b9b32-cc39-4848-a9fb-7afa3777f066 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:53.691830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-531b9b32-cc39-4848-a9fb-7afa3777f066 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:53.692289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-531b9b32-cc39-4848-a9fb-7afa3777f066 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:53.692717 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-531b9b32-cc39-4848-a9fb-7afa3777f066 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:53.706392 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-531b9b32-cc39-4848-a9fb-7afa3777f066 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] HTTP exception thrown: Instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 could not be found. Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-531b9b32-cc39-4848-a9fb-7afa3777f066 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Request method failure captured: Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 HTTP/1.1 Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JhG_obk1inmT-LpGftVC8T_Y8-pPVjLVEglzNX3UWJnFKSaygoEUadJWBB4wc6CY_m1NhNRYkDoN3i_zhO67OseVSYrxfs2pq5bj9nfMx8H5Hjc4Mn1eAzXoC5ol4Ys42C-4fT14ZE_lGe5ULsQ0w7YQ1WfiQ-SVzhswGz_4MT3Z6s Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 3c491181ae054706be3bdc94c61501f9 Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-AttachVolumeTestJSON-1998608911 Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:33:53.707938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:33:53.709330 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3c491181ae054706be3bdc94c61501f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3c491181ae054706be3bdc94c61501f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c491181ae054706be3bdc94c61501f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c491181ae054706be3bdc94c61501f9"}]}] Aug 17 07:33:53.709330 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-AttachVolumeTestJSON-1998608911 Aug 17 07:33:53.709330 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 3c491181ae054706be3bdc94c61501f9 Aug 17 07:33:53.709330 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1998608911 Aug 17 07:33:53.709330 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-AttachVolumeTestJSON-1998608911-project Aug 17 07:33:53.709330 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:33:53.709330 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:33:53.709330 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: c11d183b3c0c4b2b83f3b52b881a72cf Aug 17 07:33:53.709330 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-AttachVolumeTestJSON-1998608911-project Aug 17 07:33:53.709330 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:33:53.709330 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 could not be found. Aug 17 07:33:53.709330 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': '4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325'} Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 could not be found. Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:33:53.710425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:33:53.711785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:33:53.711785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:33:53.711785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:33:53.711785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:33:53.711785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:33:53.711785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:33:53.711785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:33:53.711785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 could not be found. Aug 17 07:33:53.711785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:53.711785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:53.711785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:53.711785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:53.711785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:53.711785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:53.711785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:33:53.711785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:33:53.711785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 could not be found. Aug 17 07:33:53.711785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:53.713619 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-531b9b32-cc39-4848-a9fb-7afa3777f066 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Returning 404 to user: Instance 4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:33:53.713619 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-531b9b32-cc39-4848-a9fb-7afa3777f066 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325" status: 404 len: 111 microversion: 2.1 time: 0.030094 Aug 17 07:33:53.713619 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 426/847] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:33:53 2022] GET /compute/v2.1/servers/4ea2d0b9-bacf-4466-8b0b-6a4a0bd3e325 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 07:33:53.756696 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-32607d49-0f42-45d9-9d6c-11e333c75548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:53.767430 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-32607d49-0f42-45d9-9d6c-11e333c75548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:53.791626 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-32607d49-0f42-45d9-9d6c-11e333c75548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:53.793446 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-32607d49-0f42-45d9-9d6c-11e333c75548 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1722 microversion: 2.20 time: 0.213538 Aug 17 07:33:53.794043 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 422/848] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:33:53 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:33:54.041748 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-52edc575-a2e2-46b3-8d00-676a19b8ec09 req-be14951e-6993-489c-9a82-df911758490f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c084749b-e2a5-48ae-a864-1ef8c56b5934", "name": "network-vif-deleted", "tag": "9ba8e1e3-4b4b-4036-bc27-7a1fb46ead6d"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:33:54.051591 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-52edc575-a2e2-46b3-8d00-676a19b8ec09 req-be14951e-6993-489c-9a82-df911758490f service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:54.052061 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-52edc575-a2e2-46b3-8d00-676a19b8ec09 req-be14951e-6993-489c-9a82-df911758490f service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:54.052473 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-52edc575-a2e2-46b3-8d00-676a19b8ec09 req-be14951e-6993-489c-9a82-df911758490f service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:54.063370 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-52edc575-a2e2-46b3-8d00-676a19b8ec09 req-be14951e-6993-489c-9a82-df911758490f service nova] Creating event network-vif-deleted:9ba8e1e3-4b4b-4036-bc27-7a1fb46ead6d for instance c084749b-e2a5-48ae-a864-1ef8c56b5934 on hv-cinder-85312 Aug 17 07:33:54.068267 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-52edc575-a2e2-46b3-8d00-676a19b8ec09 req-be14951e-6993-489c-9a82-df911758490f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030241 Aug 17 07:33:54.068845 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 427/849] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:33:54.819564 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ea6db9fc-39c8-46fe-b24e-d41b8214cb00 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:54.820180 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ea6db9fc-39c8-46fe-b24e-d41b8214cb00 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:54.827185 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ea6db9fc-39c8-46fe-b24e-d41b8214cb00 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:54.827737 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ea6db9fc-39c8-46fe-b24e-d41b8214cb00 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:54.828214 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ea6db9fc-39c8-46fe-b24e-d41b8214cb00 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:54.828918 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ea6db9fc-39c8-46fe-b24e-d41b8214cb00 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:54.829547 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ea6db9fc-39c8-46fe-b24e-d41b8214cb00 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:54.830105 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ea6db9fc-39c8-46fe-b24e-d41b8214cb00 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:54.903418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ea6db9fc-39c8-46fe-b24e-d41b8214cb00 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:54.912045 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ea6db9fc-39c8-46fe-b24e-d41b8214cb00 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:54.913557 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ea6db9fc-39c8-46fe-b24e-d41b8214cb00 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:54.914738 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ea6db9fc-39c8-46fe-b24e-d41b8214cb00 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1366 microversion: 2.20 time: 0.099612 Aug 17 07:33:54.915513 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 423/850] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:33:54 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:33:55.939160 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-55591f37-0c68-45f7-bf36-52c072243e8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:55.939860 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-55591f37-0c68-45f7-bf36-52c072243e8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:55.945978 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-55591f37-0c68-45f7-bf36-52c072243e8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:55.946502 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-55591f37-0c68-45f7-bf36-52c072243e8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:55.946935 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-55591f37-0c68-45f7-bf36-52c072243e8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:55.947621 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-55591f37-0c68-45f7-bf36-52c072243e8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:55.948071 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-55591f37-0c68-45f7-bf36-52c072243e8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:55.948495 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-55591f37-0c68-45f7-bf36-52c072243e8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:55.979165 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-55591f37-0c68-45f7-bf36-52c072243e8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:55.979629 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-55591f37-0c68-45f7-bf36-52c072243e8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:55.980064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-55591f37-0c68-45f7-bf36-52c072243e8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:55.980504 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.objects.instance [None req-55591f37-0c68-45f7-bf36-52c072243e8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lazy-loading 'fault' on Instance uuid c084749b-e2a5-48ae-a864-1ef8c56b5934 {{(pid=120835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:33:56.020857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-55591f37-0c68-45f7-bf36-52c072243e8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:56.028587 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-55591f37-0c68-45f7-bf36-52c072243e8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:56.030111 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-55591f37-0c68-45f7-bf36-52c072243e8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21e14b8bcd4442168c2d1b7cfc956dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fb14530132434d959da285830fa9b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:33:56.031253 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-55591f37-0c68-45f7-bf36-52c072243e8a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 200 len: 1371 microversion: 2.20 time: 0.098224 Aug 17 07:33:56.031802 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 428/851] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:33:55 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 07:33:56.976196 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-59cf210b-9ecc-428a-829d-99bcc6491f96 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:56.976734 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-59cf210b-9ecc-428a-829d-99bcc6491f96 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:56.983104 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-59cf210b-9ecc-428a-829d-99bcc6491f96 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:56.983576 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-59cf210b-9ecc-428a-829d-99bcc6491f96 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:56.984003 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-59cf210b-9ecc-428a-829d-99bcc6491f96 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:56.984684 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-59cf210b-9ecc-428a-829d-99bcc6491f96 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:56.985124 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-59cf210b-9ecc-428a-829d-99bcc6491f96 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:56.985544 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-59cf210b-9ecc-428a-829d-99bcc6491f96 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:56.999211 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-59cf210b-9ecc-428a-829d-99bcc6491f96 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] HTTP exception thrown: Instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 could not be found. Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-59cf210b-9ecc-428a-829d-99bcc6491f96 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Request method failure captured: Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: DELETE /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 HTTP/1.1 Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JhG_obk1inmT-LpGftVC8T_Y8-pPVjLVEglzNX3UWJnFKSaygoEUadJWBB4wc6CY_m1NhNRYkDoN3i_zhO67OseVSYrxfs2pq5bj9nfMx8H5Hjc4Mn1eAzXoC5ol4Ys42C-4fT14ZE_lGe5ULsQ0w7YQ1WfiQ-SVzhswGz_4MT3Z6s Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 3c491181ae054706be3bdc94c61501f9 Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-AttachVolumeTestJSON-1998608911 Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:33:57.000827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:33:57.002428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3c491181ae054706be3bdc94c61501f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3c491181ae054706be3bdc94c61501f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c491181ae054706be3bdc94c61501f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c491181ae054706be3bdc94c61501f9"}]}] Aug 17 07:33:57.002428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-AttachVolumeTestJSON-1998608911 Aug 17 07:33:57.002428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 3c491181ae054706be3bdc94c61501f9 Aug 17 07:33:57.002428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1998608911 Aug 17 07:33:57.002428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-AttachVolumeTestJSON-1998608911-project Aug 17 07:33:57.002428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:33:57.002428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:33:57.002428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: c11d183b3c0c4b2b83f3b52b881a72cf Aug 17 07:33:57.002428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-AttachVolumeTestJSON-1998608911-project Aug 17 07:33:57.002428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:33:57.002428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 could not be found. Aug 17 07:33:57.002428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': '84d1495a-563e-4c4f-ba8c-1fa046813a22'} Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 could not be found. Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:33:57.003345 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 could not be found. Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 could not be found. Aug 17 07:33:57.004837 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:57.006681 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-59cf210b-9ecc-428a-829d-99bcc6491f96 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Returning 404 to user: Instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:33:57.006681 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-59cf210b-9ecc-428a-829d-99bcc6491f96 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "DELETE /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 404 len: 111 microversion: 2.1 time: 0.030360 Aug 17 07:33:57.006681 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 424/852] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:33:56 2022] DELETE /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:33:57.010493 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3e3d95ac-7ebb-42bf-97dd-be1191fbd6c7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:57.011108 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-3e3d95ac-7ebb-42bf-97dd-be1191fbd6c7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] [instance: 84d1495a-563e-4c4f-ba8c-1fa046813a22] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:57.017402 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3e3d95ac-7ebb-42bf-97dd-be1191fbd6c7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:57.017883 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3e3d95ac-7ebb-42bf-97dd-be1191fbd6c7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:57.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3e3d95ac-7ebb-42bf-97dd-be1191fbd6c7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:57.019039 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3e3d95ac-7ebb-42bf-97dd-be1191fbd6c7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:57.019496 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3e3d95ac-7ebb-42bf-97dd-be1191fbd6c7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:57.019926 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3e3d95ac-7ebb-42bf-97dd-be1191fbd6c7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:57.032769 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-3e3d95ac-7ebb-42bf-97dd-be1191fbd6c7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] HTTP exception thrown: Instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 could not be found. Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3e3d95ac-7ebb-42bf-97dd-be1191fbd6c7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Request method failure captured: Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 HTTP/1.1 Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JhG_obk1inmT-LpGftVC8T_Y8-pPVjLVEglzNX3UWJnFKSaygoEUadJWBB4wc6CY_m1NhNRYkDoN3i_zhO67OseVSYrxfs2pq5bj9nfMx8H5Hjc4Mn1eAzXoC5ol4Ys42C-4fT14ZE_lGe5ULsQ0w7YQ1WfiQ-SVzhswGz_4MT3Z6s Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 3c491181ae054706be3bdc94c61501f9 Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-AttachVolumeTestJSON-1998608911 Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:33:57.034923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:33:57.036534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3c491181ae054706be3bdc94c61501f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3c491181ae054706be3bdc94c61501f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c491181ae054706be3bdc94c61501f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c491181ae054706be3bdc94c61501f9"}]}] Aug 17 07:33:57.036534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-AttachVolumeTestJSON-1998608911 Aug 17 07:33:57.036534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 3c491181ae054706be3bdc94c61501f9 Aug 17 07:33:57.036534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1998608911 Aug 17 07:33:57.036534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-AttachVolumeTestJSON-1998608911-project Aug 17 07:33:57.036534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:33:57.036534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:33:57.036534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: c11d183b3c0c4b2b83f3b52b881a72cf Aug 17 07:33:57.036534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-AttachVolumeTestJSON-1998608911-project Aug 17 07:33:57.036534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:33:57.036534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 could not be found. Aug 17 07:33:57.036534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': '84d1495a-563e-4c4f-ba8c-1fa046813a22'} Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 could not be found. Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:33:57.037700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:33:57.039244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:33:57.039244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:33:57.039244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:33:57.039244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:33:57.039244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:33:57.039244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:33:57.039244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:33:57.039244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 could not be found. Aug 17 07:33:57.039244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:57.039244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:57.039244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:57.039244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:57.039244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:57.039244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:57.039244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:33:57.039244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:33:57.039244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 could not be found. Aug 17 07:33:57.039244 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:57.040669 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3e3d95ac-7ebb-42bf-97dd-be1191fbd6c7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] Returning 404 to user: Instance 84d1495a-563e-4c4f-ba8c-1fa046813a22 could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:33:57.040669 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-3e3d95ac-7ebb-42bf-97dd-be1191fbd6c7 tempest-AttachVolumeTestJSON-1998608911 tempest-AttachVolumeTestJSON-1998608911-project] 10.222.0.45 "GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22" status: 404 len: 111 microversion: 2.1 time: 0.029634 Aug 17 07:33:57.040669 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 429/853] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:33:57 2022] GET /compute/v2.1/servers/84d1495a-563e-4c4f-ba8c-1fa046813a22 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 07:33:57.054590 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-5dbccd78-bc33-424b-a637-f7ee68021d53 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:57.055202 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-5dbccd78-bc33-424b-a637-f7ee68021d53 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:57.061138 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5dbccd78-bc33-424b-a637-f7ee68021d53 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:57.061624 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5dbccd78-bc33-424b-a637-f7ee68021d53 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:57.062090 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5dbccd78-bc33-424b-a637-f7ee68021d53 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:57.062782 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5dbccd78-bc33-424b-a637-f7ee68021d53 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:57.063239 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5dbccd78-bc33-424b-a637-f7ee68021d53 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:57.063668 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5dbccd78-bc33-424b-a637-f7ee68021d53 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:57.077377 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-5dbccd78-bc33-424b-a637-f7ee68021d53 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] HTTP exception thrown: Instance c084749b-e2a5-48ae-a864-1ef8c56b5934 could not be found. Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-5dbccd78-bc33-424b-a637-f7ee68021d53 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Request method failure captured: Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 HTTP/1.1 Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_Jg_8pWHtbGFxg2hEbayc35kHSWHvwkVZX6Bi4Mk8hPivS4i1nayElyjynajz8n4gLfessj95YpoMPJp5GTkZOEam_efTl429cUrsmPKZGkI-W1T3uRrj1gnRWobilaxEN-hKbKI_JdbUrO6XCommw0qVP7AmmTSwD0Xi5TIP2qTTCk Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 58fb14530132434d959da285830fa9b6 Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-236675951 Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:33:57.079014 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:33:57.080460 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_58fb14530132434d959da285830fa9b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/58fb14530132434d959da285830fa9b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/58fb14530132434d959da285830fa9b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/58fb14530132434d959da285830fa9b6"}]}] Aug 17 07:33:57.080460 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-AttachVolumeShelveTestJSON-236675951 Aug 17 07:33:57.080460 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 58fb14530132434d959da285830fa9b6 Aug 17 07:33:57.080460 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-236675951 Aug 17 07:33:57.080460 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-AttachVolumeShelveTestJSON-236675951-project Aug 17 07:33:57.080460 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:33:57.080460 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:33:57.080460 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: 21e14b8bcd4442168c2d1b7cfc956dce Aug 17 07:33:57.080460 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-AttachVolumeShelveTestJSON-236675951-project Aug 17 07:33:57.080460 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:33:57.080460 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance c084749b-e2a5-48ae-a864-1ef8c56b5934 could not be found. Aug 17 07:33:57.080460 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': 'c084749b-e2a5-48ae-a864-1ef8c56b5934'} Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c084749b-e2a5-48ae-a864-1ef8c56b5934 could not be found. Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:33:57.081197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:33:57.082603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:33:57.082603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:33:57.082603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:33:57.082603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:33:57.082603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:33:57.082603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:33:57.082603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:33:57.082603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c084749b-e2a5-48ae-a864-1ef8c56b5934 could not be found. Aug 17 07:33:57.082603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:57.082603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:57.082603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:57.082603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:57.082603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:57.082603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:57.082603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:33:57.082603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:33:57.082603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c084749b-e2a5-48ae-a864-1ef8c56b5934 could not be found. Aug 17 07:33:57.082603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:57.083929 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-5dbccd78-bc33-424b-a637-f7ee68021d53 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Returning 404 to user: Instance c084749b-e2a5-48ae-a864-1ef8c56b5934 could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:33:57.083929 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-5dbccd78-bc33-424b-a637-f7ee68021d53 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 404 len: 111 microversion: 2.20 time: 0.030334 Aug 17 07:33:57.083929 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 425/854] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:33:57 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 07:33:57.089198 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c49c80cd-2db7-40dc-83b9-fcb18471027a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '.version_select at 0x7f30ac1dbaf0>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:57.109240 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-c49c80cd-2db7-40dc-83b9-fcb18471027a tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2018583493" status: 204 len: 0 microversion: 2.20 time: 0.023792 Aug 17 07:33:57.110030 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 430/855] 10.222.0.45 () {60 vars in 1262 bytes} [Wed Aug 17 07:33:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2018583493 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 07:33:58.876497 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-043376ff-460e-45e3-bb8d-ac74a96bd560 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:58.877875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-043376ff-460e-45e3-bb8d-ac74a96bd560 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:58.884633 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-043376ff-460e-45e3-bb8d-ac74a96bd560 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:58.885204 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-043376ff-460e-45e3-bb8d-ac74a96bd560 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:58.885716 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-043376ff-460e-45e3-bb8d-ac74a96bd560 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:58.886595 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-043376ff-460e-45e3-bb8d-ac74a96bd560 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:58.887206 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-043376ff-460e-45e3-bb8d-ac74a96bd560 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:58.887704 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-043376ff-460e-45e3-bb8d-ac74a96bd560 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:58.904138 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-043376ff-460e-45e3-bb8d-ac74a96bd560 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] HTTP exception thrown: Instance c084749b-e2a5-48ae-a864-1ef8c56b5934 could not be found. Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-043376ff-460e-45e3-bb8d-ac74a96bd560 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Request method failure captured: Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: DELETE /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 HTTP/1.1 Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_Jg_8pWHtbGFxg2hEbayc35kHSWHvwkVZX6Bi4Mk8hPivS4i1nayElyjynajz8n4gLfessj95YpoMPJp5GTkZOEam_efTl429cUrsmPKZGkI-W1T3uRrj1gnRWobilaxEN-hKbKI_JdbUrO6XCommw0qVP7AmmTSwD0Xi5TIP2qTTCk Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 58fb14530132434d959da285830fa9b6 Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-236675951 Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:33:58.905805 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:33:58.907393 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_58fb14530132434d959da285830fa9b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/58fb14530132434d959da285830fa9b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/58fb14530132434d959da285830fa9b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/58fb14530132434d959da285830fa9b6"}]}] Aug 17 07:33:58.907393 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-AttachVolumeShelveTestJSON-236675951 Aug 17 07:33:58.907393 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 58fb14530132434d959da285830fa9b6 Aug 17 07:33:58.907393 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-236675951 Aug 17 07:33:58.907393 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-AttachVolumeShelveTestJSON-236675951-project Aug 17 07:33:58.907393 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:33:58.907393 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:33:58.907393 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: 21e14b8bcd4442168c2d1b7cfc956dce Aug 17 07:33:58.907393 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-AttachVolumeShelveTestJSON-236675951-project Aug 17 07:33:58.907393 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:33:58.907393 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance c084749b-e2a5-48ae-a864-1ef8c56b5934 could not be found. Aug 17 07:33:58.907393 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': 'c084749b-e2a5-48ae-a864-1ef8c56b5934'} Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c084749b-e2a5-48ae-a864-1ef8c56b5934 could not be found. Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:33:58.908163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c084749b-e2a5-48ae-a864-1ef8c56b5934 could not be found. Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c084749b-e2a5-48ae-a864-1ef8c56b5934 could not be found. Aug 17 07:33:58.910162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:33:58.911457 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-043376ff-460e-45e3-bb8d-ac74a96bd560 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Returning 404 to user: Instance c084749b-e2a5-48ae-a864-1ef8c56b5934 could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:33:58.911457 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-043376ff-460e-45e3-bb8d-ac74a96bd560 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 404 len: 111 microversion: 2.20 time: 0.034764 Aug 17 07:33:58.911457 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 426/856] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 17 07:33:58 2022] DELETE /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 07:33:58.916715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-bc3cbf93-9b5a-4476-a693-4226a33a4d5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:33:58.917457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-bc3cbf93-9b5a-4476-a693-4226a33a4d5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: c084749b-e2a5-48ae-a864-1ef8c56b5934] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:33:58.923955 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bc3cbf93-9b5a-4476-a693-4226a33a4d5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:58.924435 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bc3cbf93-9b5a-4476-a693-4226a33a4d5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:58.925079 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bc3cbf93-9b5a-4476-a693-4226a33a4d5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:58.925814 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bc3cbf93-9b5a-4476-a693-4226a33a4d5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:33:58.926430 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bc3cbf93-9b5a-4476-a693-4226a33a4d5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:33:58.926863 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bc3cbf93-9b5a-4476-a693-4226a33a4d5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:33:58.940859 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-bc3cbf93-9b5a-4476-a693-4226a33a4d5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] HTTP exception thrown: Instance c084749b-e2a5-48ae-a864-1ef8c56b5934 could not be found. Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-bc3cbf93-9b5a-4476-a693-4226a33a4d5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Request method failure captured: Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 HTTP/1.1 Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_Jg_8pWHtbGFxg2hEbayc35kHSWHvwkVZX6Bi4Mk8hPivS4i1nayElyjynajz8n4gLfessj95YpoMPJp5GTkZOEam_efTl429cUrsmPKZGkI-W1T3uRrj1gnRWobilaxEN-hKbKI_JdbUrO6XCommw0qVP7AmmTSwD0Xi5TIP2qTTCk Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 58fb14530132434d959da285830fa9b6 Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-236675951 Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:33:58.942522 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:33:58.944248 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_58fb14530132434d959da285830fa9b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/58fb14530132434d959da285830fa9b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/58fb14530132434d959da285830fa9b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/58fb14530132434d959da285830fa9b6"}]}] Aug 17 07:33:58.944248 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-AttachVolumeShelveTestJSON-236675951 Aug 17 07:33:58.944248 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 58fb14530132434d959da285830fa9b6 Aug 17 07:33:58.944248 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-236675951 Aug 17 07:33:58.944248 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-AttachVolumeShelveTestJSON-236675951-project Aug 17 07:33:58.944248 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:33:58.944248 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:33:58.944248 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: 21e14b8bcd4442168c2d1b7cfc956dce Aug 17 07:33:58.944248 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-AttachVolumeShelveTestJSON-236675951-project Aug 17 07:33:58.944248 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:33:58.944248 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance c084749b-e2a5-48ae-a864-1ef8c56b5934 could not be found. Aug 17 07:33:58.944248 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': 'c084749b-e2a5-48ae-a864-1ef8c56b5934'} Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c084749b-e2a5-48ae-a864-1ef8c56b5934 could not be found. Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:33:58.945193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:33:58.946828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:33:58.946828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:33:58.946828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:33:58.946828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:33:58.946828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:33:58.946828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:33:58.946828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:33:58.946828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c084749b-e2a5-48ae-a864-1ef8c56b5934 could not be found. Aug 17 07:33:58.946828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:58.946828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:33:58.946828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:58.946828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:33:58.946828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:33:58.946828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:33:58.946828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:33:58.946828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:33:58.946828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c084749b-e2a5-48ae-a864-1ef8c56b5934 could not be found. Aug 17 07:33:58.946828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:33:58.948512 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-bc3cbf93-9b5a-4476-a693-4226a33a4d5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Returning 404 to user: Instance c084749b-e2a5-48ae-a864-1ef8c56b5934 could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:33:58.948512 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-bc3cbf93-9b5a-4476-a693-4226a33a4d5f tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934" status: 404 len: 111 microversion: 2.20 time: 0.031416 Aug 17 07:33:58.956046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 431/857] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:33:58 2022] GET /compute/v2.1/servers/c084749b-e2a5-48ae-a864-1ef8c56b5934 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 07:34:01.201048 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-dc7253ed-9725-4471-b678-e5631f410ac2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:01.201681 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-dc7253ed-9725-4471-b678-e5631f410ac2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:01.210423 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dc7253ed-9725-4471-b678-e5631f410ac2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:01.211004 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dc7253ed-9725-4471-b678-e5631f410ac2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:01.211665 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dc7253ed-9725-4471-b678-e5631f410ac2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:01.212434 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dc7253ed-9725-4471-b678-e5631f410ac2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:01.212956 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dc7253ed-9725-4471-b678-e5631f410ac2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:01.213449 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dc7253ed-9725-4471-b678-e5631f410ac2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:01.228627 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-dc7253ed-9725-4471-b678-e5631f410ac2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] HTTP exception thrown: Instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 could not be found. Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-dc7253ed-9725-4471-b678-e5631f410ac2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Request method failure captured: Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: DELETE /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 HTTP/1.1 Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_Jg_8pWHtbGFxg2hEbayc35kHSWHvwkVZX6Bi4Mk8hPivS4i1nayElyjynajz8n4gLfessj95YpoMPJp5GTkZOEam_efTl429cUrsmPKZGkI-W1T3uRrj1gnRWobilaxEN-hKbKI_JdbUrO6XCommw0qVP7AmmTSwD0Xi5TIP2qTTCk Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 58fb14530132434d959da285830fa9b6 Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-236675951 Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:34:01.230412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:34:01.232282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_58fb14530132434d959da285830fa9b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/58fb14530132434d959da285830fa9b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/58fb14530132434d959da285830fa9b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/58fb14530132434d959da285830fa9b6"}]}] Aug 17 07:34:01.232282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-AttachVolumeShelveTestJSON-236675951 Aug 17 07:34:01.232282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 58fb14530132434d959da285830fa9b6 Aug 17 07:34:01.232282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-236675951 Aug 17 07:34:01.232282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-AttachVolumeShelveTestJSON-236675951-project Aug 17 07:34:01.232282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:34:01.232282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:34:01.232282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: 21e14b8bcd4442168c2d1b7cfc956dce Aug 17 07:34:01.232282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-AttachVolumeShelveTestJSON-236675951-project Aug 17 07:34:01.232282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:34:01.232282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 could not be found. Aug 17 07:34:01.232282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': '5ebfec5b-68c1-41cd-910b-e73220fc2fd6'} Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 could not be found. Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:34:01.233364 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 could not be found. Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 could not be found. Aug 17 07:34:01.235035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:34:01.236585 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-dc7253ed-9725-4471-b678-e5631f410ac2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Returning 404 to user: Instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:34:01.236585 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-dc7253ed-9725-4471-b678-e5631f410ac2 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 404 len: 111 microversion: 2.20 time: 0.038330 Aug 17 07:34:01.236585 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 427/858] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 17 07:34:01 2022] DELETE /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 07:34:01.244982 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-53342020-fd8b-404d-b35e-1f355c1f0f31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:01.245677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-53342020-fd8b-404d-b35e-1f355c1f0f31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] [instance: 5ebfec5b-68c1-41cd-910b-e73220fc2fd6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:01.252472 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53342020-fd8b-404d-b35e-1f355c1f0f31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:01.253644 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53342020-fd8b-404d-b35e-1f355c1f0f31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:01.254186 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53342020-fd8b-404d-b35e-1f355c1f0f31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:01.254956 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53342020-fd8b-404d-b35e-1f355c1f0f31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:01.255535 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53342020-fd8b-404d-b35e-1f355c1f0f31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:01.256049 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-53342020-fd8b-404d-b35e-1f355c1f0f31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:01.270254 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-53342020-fd8b-404d-b35e-1f355c1f0f31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] HTTP exception thrown: Instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 could not be found. Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-53342020-fd8b-404d-b35e-1f355c1f0f31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Request method failure captured: Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 HTTP/1.1 Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_Jg_8pWHtbGFxg2hEbayc35kHSWHvwkVZX6Bi4Mk8hPivS4i1nayElyjynajz8n4gLfessj95YpoMPJp5GTkZOEam_efTl429cUrsmPKZGkI-W1T3uRrj1gnRWobilaxEN-hKbKI_JdbUrO6XCommw0qVP7AmmTSwD0Xi5TIP2qTTCk Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 58fb14530132434d959da285830fa9b6 Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-236675951 Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:34:01.271891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:34:01.273313 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_58fb14530132434d959da285830fa9b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/58fb14530132434d959da285830fa9b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/58fb14530132434d959da285830fa9b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/58fb14530132434d959da285830fa9b6"}]}] Aug 17 07:34:01.273313 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-AttachVolumeShelveTestJSON-236675951 Aug 17 07:34:01.273313 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 58fb14530132434d959da285830fa9b6 Aug 17 07:34:01.273313 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-236675951 Aug 17 07:34:01.273313 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-AttachVolumeShelveTestJSON-236675951-project Aug 17 07:34:01.273313 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:34:01.273313 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:34:01.273313 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: 21e14b8bcd4442168c2d1b7cfc956dce Aug 17 07:34:01.273313 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-AttachVolumeShelveTestJSON-236675951-project Aug 17 07:34:01.273313 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:34:01.273313 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 could not be found. Aug 17 07:34:01.273313 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': '5ebfec5b-68c1-41cd-910b-e73220fc2fd6'} Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 could not be found. Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:34:01.274135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:34:01.276051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:34:01.276051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:34:01.276051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:34:01.276051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:34:01.276051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:34:01.276051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:34:01.276051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:34:01.276051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 could not be found. Aug 17 07:34:01.276051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:34:01.276051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:34:01.276051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:34:01.276051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:34:01.276051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:34:01.276051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:34:01.276051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:34:01.276051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:34:01.276051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 could not be found. Aug 17 07:34:01.276051 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:34:01.277954 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-53342020-fd8b-404d-b35e-1f355c1f0f31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] Returning 404 to user: Instance 5ebfec5b-68c1-41cd-910b-e73220fc2fd6 could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:34:01.277954 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-53342020-fd8b-404d-b35e-1f355c1f0f31 tempest-AttachVolumeShelveTestJSON-236675951 tempest-AttachVolumeShelveTestJSON-236675951-project] 10.222.0.45 "GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6" status: 404 len: 111 microversion: 2.20 time: 0.034196 Aug 17 07:34:01.277954 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 432/859] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 17 07:34:01 2022] GET /compute/v2.1/servers/5ebfec5b-68c1-41cd-910b-e73220fc2fd6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 07:34:05.953476 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-34135591-0ab7-4dfc-8f25-5b1c598c99f5 tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] Action: 'create', calling method: .version_select at 0x7f30ac32d550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-833272700", "metadata": {"Type": "work"}}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:34:06.282401 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-34135591-0ab7-4dfc-8f25-5b1c598c99f5 tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.494556 Aug 17 07:34:06.283101 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 428/860] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 17 07:34:05 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 500 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 17 07:34:06.296965 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-0b844104-87f5-4173-b080-85c91a2c8a7f tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] Calling method '.version_select at 0x7f30ac1dbd30>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:06.361058 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-0b844104-87f5-4173-b080-85c91a2c8a7f tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced" status: 200 len: 352 microversion: 2.1 time: 0.069676 Aug 17 07:34:06.363382 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 433/861] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:34:06 2022] GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:34:07.376962 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-d7e848af-cfd7-48d9-8a82-16d1bd5b2f55 tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] Calling method '.version_select at 0x7f30ac211dc0>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:07.428399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-d7e848af-cfd7-48d9-8a82-16d1bd5b2f55 tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced" status: 200 len: 352 microversion: 2.1 time: 0.055683 Aug 17 07:34:07.428966 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 429/862] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:34:07 2022] GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:34:08.442461 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-43abf5b0-8ee2-42d8-a70c-d96135b37c72 tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] Calling method '.version_select at 0x7f30ac087820>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:08.495540 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-43abf5b0-8ee2-42d8-a70c-d96135b37c72 tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced" status: 200 len: 352 microversion: 2.1 time: 0.057531 Aug 17 07:34:08.496103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 434/863] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:34:08 2022] GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:34:09.511182 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-da0521b3-43a8-4c50-a39e-4d7e4f0d21e5 tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] Calling method '.version_select at 0x7f30ac19e430>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:09.567566 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-da0521b3-43a8-4c50-a39e-4d7e4f0d21e5 tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced" status: 200 len: 353 microversion: 2.1 time: 0.060500 Aug 17 07:34:09.568456 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 430/864] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:34:09 2022] GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:34:09.581845 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e31d7dd7-ae96-4fbf-bc40-97cc0649a814 tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] Calling method '.version_select at 0x7f30ac1db700>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:09.631175 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e31d7dd7-ae96-4fbf-bc40-97cc0649a814 tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced" status: 200 len: 353 microversion: 2.1 time: 0.054111 Aug 17 07:34:09.631742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 435/865] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:34:09 2022] GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:34:09.649632 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a1e558ba-6e6b-4bd2-8a3d-c9aca4a3c2f2 tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] Calling method '.version_select at 0x7f30ac1d6d30>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:09.714780 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a1e558ba-6e6b-4bd2-8a3d-c9aca4a3c2f2 tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced" status: 202 len: 0 microversion: 2.1 time: 0.068224 Aug 17 07:34:09.714780 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 431/866] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 17 07:34:09 2022] DELETE /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:34:09.723075 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3c350322-4672-4f8c-b608-d5b5a04d6d0e tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] Calling method '.version_select at 0x7f30ac1dbaf0>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:09.779116 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-3c350322-4672-4f8c-b608-d5b5a04d6d0e tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced" status: 200 len: 352 microversion: 2.1 time: 0.059801 Aug 17 07:34:09.779689 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 436/867] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:34:09 2022] GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:34:10.793520 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-4114ffe3-dae1-4909-b878-4f76930b6b1a tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] Calling method '.version_select at 0x7f30ac3d4e50>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:10.841158 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-4114ffe3-dae1-4909-b878-4f76930b6b1a tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced" status: 200 len: 352 microversion: 2.1 time: 0.052556 Aug 17 07:34:10.841729 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 432/868] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:34:10 2022] GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:34:11.852610 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:11.853297 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=67 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:11.857141 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-66e10888-030d-4d6e-a6bf-2b2424f0823f tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] Calling method '.version_select at 0x7f30ac239a60>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:11.907416 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-66e10888-030d-4d6e-a6bf-2b2424f0823f tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced" status: 200 len: 352 microversion: 2.1 time: 0.056053 Aug 17 07:34:11.908005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 437/869] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:34:11 2022] GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:34:12.917996 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:12.918743 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:12.923314 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-17cb2427-8779-4316-aa75-27d154a58888 tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] Calling method '.version_select at 0x7f30ac32d4c0>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:12.974061 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-17cb2427-8779-4316-aa75-27d154a58888 tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced" status: 200 len: 352 microversion: 2.1 time: 0.056831 Aug 17 07:34:12.974616 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 433/870] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:34:12 2022] GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:34:13.987465 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-92fda93b-c367-4e7f-b33e-b9d48b44205c tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] Calling method '.version_select at 0x7f30ac1db160>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:14.032849 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-92fda93b-c367-4e7f-b33e-b9d48b44205c tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced" status: 200 len: 352 microversion: 2.1 time: 0.050038 Aug 17 07:34:14.033507 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 438/871] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:34:13 2022] GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:34:14.972469 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ee63efbd-3f7f-47a9-bf3d-21bc27d84901 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-633671099", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-800034190", "security_groups": [{"name": "tempest-secgroup-smoke-563096334"}], "block_device_mapping_v2": [{"uuid": "c6865c48-57e0-4d0b-952d-4c7928d59af9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7da685da-5755-4a74-ae7f-f5d4d0aa3b15"}]}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:34:15.047501 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-532ce2c2-8ae0-470d-aae1-859b48d8f58c tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] Calling method '.version_select at 0x7f30ac0875e0>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:15.088256 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-532ce2c2-8ae0-470d-aae1-859b48d8f58c tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] HTTP exception thrown: Volume 0f8f233c-4a00-4c2c-92a8-0c6581314ced could not be found. Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-532ce2c2-8ae0-470d-aae1-859b48d8f58c tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] Request method failure captured: Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced HTTP/1.1 Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JntCFcuYs8jHML0J1BGJ-DS1K17zV6QOi7NXp9wn7BHcGryXyUz339wteiFcNHZrzpRU_0jx4QtykEMjV5VZOy5k98qmwcuNbF3ldj7cMR8IHQEiThv-Fm9KxZFOIoCuS3Quevfaz28P3C5m9Ex46T1fVudZF-TBrYktck6wywRiOY Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 0780e30f2e15409f8d0998908d305e0b Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-VolumesGetTestJSON-626421661 Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:34:15.090768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:34:15.092190 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0780e30f2e15409f8d0998908d305e0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0780e30f2e15409f8d0998908d305e0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0780e30f2e15409f8d0998908d305e0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0780e30f2e15409f8d0998908d305e0b"}]}] Aug 17 07:34:15.092190 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-VolumesGetTestJSON-626421661 Aug 17 07:34:15.092190 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 0780e30f2e15409f8d0998908d305e0b Aug 17 07:34:15.092190 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-VolumesGetTestJSON-626421661 Aug 17 07:34:15.092190 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-VolumesGetTestJSON-626421661-project Aug 17 07:34:15.092190 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:34:15.092190 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:34:15.092190 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: 45e0a7d185b54838a564c26e54f1289c Aug 17 07:34:15.092190 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-VolumesGetTestJSON-626421661-project Aug 17 07:34:15.092190 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: Aug 17 07:34:15.092190 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Volume 0f8f233c-4a00-4c2c-92a8-0c6581314ced could not be found. Aug 17 07:34:15.092190 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': '0f8f233c-4a00-4c2c-92a8-0c6581314ced'} Aug 17 07:34:15.092190 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0f8f233c-4a00-4c2c-92a8-0c6581314ced could not be found. (HTTP 404) (Request-ID: req-b7054616-5fd0-4caf-a37d-ccf610c1a10e) Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:34:15.093369 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 07:34:15.094628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0f8f233c-4a00-4c2c-92a8-0c6581314ced could not be found. Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 07:34:15.096323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:34:15.097715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0f8f233c-4a00-4c2c-92a8-0c6581314ced could not be found. Aug 17 07:34:15.097715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:34:15.097715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:34:15.097715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:34:15.097715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:34:15.097715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:34:15.097715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:34:15.097715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:34:15.097715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:34:15.097715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0f8f233c-4a00-4c2c-92a8-0c6581314ced could not be found. Aug 17 07:34:15.097715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:34:15.097715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-532ce2c2-8ae0-470d-aae1-859b48d8f58c tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] Returning 404 to user: Volume 0f8f233c-4a00-4c2c-92a8-0c6581314ced could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:34:15.097715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-532ce2c2-8ae0-470d-aae1-859b48d8f58c tempest-VolumesGetTestJSON-626421661 tempest-VolumesGetTestJSON-626421661-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced" status: 404 len: 109 microversion: 2.1 time: 0.048941 Aug 17 07:34:15.097715 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 439/872] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 17 07:34:15 2022] GET /compute/v2.1/os-volumes/0f8f233c-4a00-4c2c-92a8-0c6581314ced => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 07:34:15.122724 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.network.neutron [None req-ee63efbd-3f7f-47a9-bf3d-21bc27d84901 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] validate_networks() for [('7da685da-5755-4a74-ae7f-f5d4d0aa3b15', None, None, None, None, None)] {{(pid=120834) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:34:15.556350 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-ee63efbd-3f7f-47a9-bf3d-21bc27d84901 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Flavor limits 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:34:15.556776 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-ee63efbd-3f7f-47a9-bf3d-21bc27d84901 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Image limits 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:34:15.557245 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-ee63efbd-3f7f-47a9-bf3d-21bc27d84901 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Flavor pref 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:34:15.557872 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-ee63efbd-3f7f-47a9-bf3d-21bc27d84901 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Image pref 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:34:15.558315 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-ee63efbd-3f7f-47a9-bf3d-21bc27d84901 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:34:15.567337 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee63efbd-3f7f-47a9-bf3d-21bc27d84901 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:15.567813 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee63efbd-3f7f-47a9-bf3d-21bc27d84901 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:15.568437 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee63efbd-3f7f-47a9-bf3d-21bc27d84901 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:15.569297 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee63efbd-3f7f-47a9-bf3d-21bc27d84901 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:15.569755 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee63efbd-3f7f-47a9-bf3d-21bc27d84901 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:15.570227 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee63efbd-3f7f-47a9-bf3d-21bc27d84901 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:15.587113 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-ee63efbd-3f7f-47a9-bf3d-21bc27d84901 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Getting quotas for project afb93daca17c466da3a698536c6b323f. Resources: {'ram', 'cores', 'instances'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:34:15.591280 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-ee63efbd-3f7f-47a9-bf3d-21bc27d84901 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Getting quotas for user b2e79830079c4aa9b95c4622bac45c74 and project afb93daca17c466da3a698536c6b323f. Resources: {'ram', 'cores', 'instances'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:34:15.652504 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ee63efbd-3f7f-47a9-bf3d-21bc27d84901 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Going to run 1 instances... {{(pid=120834) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:34:15.654792 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ee63efbd-3f7f-47a9-bf3d-21bc27d84901 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c6865c48-57e0-4d0b-952d-4c7928d59af9',volume_size=None,volume_type=None)] {{(pid=120834) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:34:15.794896 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ee63efbd-3f7f-47a9-bf3d-21bc27d84901 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.826840 Aug 17 07:34:15.801920 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 434/873] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:34:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 07:34:15.807329 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-12219366-a387-46ac-8017-e95aeec6cdfa tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:15.807941 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-12219366-a387-46ac-8017-e95aeec6cdfa tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:15.874243 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-12219366-a387-46ac-8017-e95aeec6cdfa tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:15.882650 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-12219366-a387-46ac-8017-e95aeec6cdfa tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1093 microversion: 2.1 time: 0.079513 Aug 17 07:34:15.883751 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 440/874] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:15 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1093 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:34:16.904715 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-26946ce3-cf46-4755-a1bb-016b6fcef4d2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:16.906304 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-26946ce3-cf46-4755-a1bb-016b6fcef4d2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:16.914638 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-26946ce3-cf46-4755-a1bb-016b6fcef4d2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:16.914744 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-26946ce3-cf46-4755-a1bb-016b6fcef4d2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:16.915344 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-26946ce3-cf46-4755-a1bb-016b6fcef4d2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:16.916254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-26946ce3-cf46-4755-a1bb-016b6fcef4d2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:16.916919 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-26946ce3-cf46-4755-a1bb-016b6fcef4d2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:16.917536 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-26946ce3-cf46-4755-a1bb-016b6fcef4d2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:17.012278 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-26946ce3-cf46-4755-a1bb-016b6fcef4d2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:17.020162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-26946ce3-cf46-4755-a1bb-016b6fcef4d2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1209 microversion: 2.1 time: 0.120060 Aug 17 07:34:17.020911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 435/875] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:16 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1209 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:18.042565 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-5e36101d-146f-4be8-8e88-5a3a82c7a948 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:18.043765 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-5e36101d-146f-4be8-8e88-5a3a82c7a948 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:18.050461 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5e36101d-146f-4be8-8e88-5a3a82c7a948 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:18.051338 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5e36101d-146f-4be8-8e88-5a3a82c7a948 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:18.052048 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5e36101d-146f-4be8-8e88-5a3a82c7a948 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:18.052895 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5e36101d-146f-4be8-8e88-5a3a82c7a948 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:18.053484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5e36101d-146f-4be8-8e88-5a3a82c7a948 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:18.054097 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5e36101d-146f-4be8-8e88-5a3a82c7a948 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:18.320086 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-5e36101d-146f-4be8-8e88-5a3a82c7a948 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:18.331039 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-5e36101d-146f-4be8-8e88-5a3a82c7a948 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1264 microversion: 2.1 time: 0.293252 Aug 17 07:34:18.332349 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 441/876] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:18 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1264 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:18.837635 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-1de7d835-d85a-4077-a31a-877625350251 req-08d06b24-56e8-48c9-b3e1-dd8e56294f9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d7f0687-dd68-40b7-9f95-279726d56bc0", "tag": "e9ed906d-2552-4f27-bf24-b8cee4b20a07"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:34:18.853487 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-1de7d835-d85a-4077-a31a-877625350251 req-08d06b24-56e8-48c9-b3e1-dd8e56294f9f service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:18.855704 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-1de7d835-d85a-4077-a31a-877625350251 req-08d06b24-56e8-48c9-b3e1-dd8e56294f9f service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:18.856569 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-1de7d835-d85a-4077-a31a-877625350251 req-08d06b24-56e8-48c9-b3e1-dd8e56294f9f service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:18.876883 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-1de7d835-d85a-4077-a31a-877625350251 req-08d06b24-56e8-48c9-b3e1-dd8e56294f9f service nova] Creating event network-changed:e9ed906d-2552-4f27-bf24-b8cee4b20a07 for instance 5d7f0687-dd68-40b7-9f95-279726d56bc0 on hv-cinder-85312 Aug 17 07:34:18.882206 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-1de7d835-d85a-4077-a31a-877625350251 req-08d06b24-56e8-48c9-b3e1-dd8e56294f9f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051295 Aug 17 07:34:18.883496 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 436/877] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:34:19.354260 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e47629a2-296e-4f74-8c55-0e4f413a2a3d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:19.354889 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e47629a2-296e-4f74-8c55-0e4f413a2a3d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:19.368584 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e47629a2-296e-4f74-8c55-0e4f413a2a3d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:19.369025 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e47629a2-296e-4f74-8c55-0e4f413a2a3d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:19.369576 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e47629a2-296e-4f74-8c55-0e4f413a2a3d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:19.370429 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e47629a2-296e-4f74-8c55-0e4f413a2a3d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:19.370864 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e47629a2-296e-4f74-8c55-0e4f413a2a3d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:19.371294 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e47629a2-296e-4f74-8c55-0e4f413a2a3d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:19.599263 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-e47629a2-296e-4f74-8c55-0e4f413a2a3d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:19.626848 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e47629a2-296e-4f74-8c55-0e4f413a2a3d tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1264 microversion: 2.1 time: 0.271713 Aug 17 07:34:19.629769 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 442/878] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:19 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1264 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:20.654502 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-8cdc18f6-d1e8-48fe-96d0-9934605cd877 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:20.655389 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-8cdc18f6-d1e8-48fe-96d0-9934605cd877 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:20.664523 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8cdc18f6-d1e8-48fe-96d0-9934605cd877 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:20.665307 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8cdc18f6-d1e8-48fe-96d0-9934605cd877 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:20.666082 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8cdc18f6-d1e8-48fe-96d0-9934605cd877 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:20.667027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8cdc18f6-d1e8-48fe-96d0-9934605cd877 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:20.667541 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8cdc18f6-d1e8-48fe-96d0-9934605cd877 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:20.668183 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-8cdc18f6-d1e8-48fe-96d0-9934605cd877 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:20.829515 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-8cdc18f6-d1e8-48fe-96d0-9934605cd877 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:20.840398 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-8cdc18f6-d1e8-48fe-96d0-9934605cd877 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1264 microversion: 2.1 time: 0.191339 Aug 17 07:34:20.841129 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 437/879] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:20 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:21.860627 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-7c0d0275-bdf3-4794-8682-f3fea154e7a9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:21.861159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-7c0d0275-bdf3-4794-8682-f3fea154e7a9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:21.868910 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7c0d0275-bdf3-4794-8682-f3fea154e7a9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:21.869415 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7c0d0275-bdf3-4794-8682-f3fea154e7a9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:21.869837 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7c0d0275-bdf3-4794-8682-f3fea154e7a9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:21.870558 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7c0d0275-bdf3-4794-8682-f3fea154e7a9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:21.871181 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7c0d0275-bdf3-4794-8682-f3fea154e7a9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:21.871769 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7c0d0275-bdf3-4794-8682-f3fea154e7a9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:22.024497 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-7c0d0275-bdf3-4794-8682-f3fea154e7a9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:22.038001 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-7c0d0275-bdf3-4794-8682-f3fea154e7a9 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1264 microversion: 2.1 time: 0.180338 Aug 17 07:34:22.039403 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 443/880] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:21 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:23.059191 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b040d187-640c-4368-984d-cf92b973b729 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:23.059797 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-b040d187-640c-4368-984d-cf92b973b729 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:23.065821 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b040d187-640c-4368-984d-cf92b973b729 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:23.066532 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b040d187-640c-4368-984d-cf92b973b729 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:23.066965 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b040d187-640c-4368-984d-cf92b973b729 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:23.067659 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b040d187-640c-4368-984d-cf92b973b729 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:23.068160 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b040d187-640c-4368-984d-cf92b973b729 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:23.068578 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b040d187-640c-4368-984d-cf92b973b729 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:23.213268 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-b040d187-640c-4368-984d-cf92b973b729 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:23.220768 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b040d187-640c-4368-984d-cf92b973b729 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1264 microversion: 2.1 time: 0.165306 Aug 17 07:34:23.222233 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 438/881] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:23 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:24.243070 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-08006be2-55e3-4eb5-bb63-0f370823d9ba tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:24.243789 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-08006be2-55e3-4eb5-bb63-0f370823d9ba tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:24.251672 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-08006be2-55e3-4eb5-bb63-0f370823d9ba tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:24.253087 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-08006be2-55e3-4eb5-bb63-0f370823d9ba tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:24.253768 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-08006be2-55e3-4eb5-bb63-0f370823d9ba tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:24.254840 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-08006be2-55e3-4eb5-bb63-0f370823d9ba tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:24.255405 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-08006be2-55e3-4eb5-bb63-0f370823d9ba tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:24.256018 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-08006be2-55e3-4eb5-bb63-0f370823d9ba tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:24.421493 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-08006be2-55e3-4eb5-bb63-0f370823d9ba tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:24.430159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-08006be2-55e3-4eb5-bb63-0f370823d9ba tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1264 microversion: 2.1 time: 0.191820 Aug 17 07:34:24.430808 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 444/882] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:24 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:25.450575 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-92394e9a-b54a-46f9-9fc1-be9137e47576 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:25.451170 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-92394e9a-b54a-46f9-9fc1-be9137e47576 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:25.458367 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-92394e9a-b54a-46f9-9fc1-be9137e47576 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:25.458880 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-92394e9a-b54a-46f9-9fc1-be9137e47576 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:25.459306 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-92394e9a-b54a-46f9-9fc1-be9137e47576 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:25.459996 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-92394e9a-b54a-46f9-9fc1-be9137e47576 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:25.460443 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-92394e9a-b54a-46f9-9fc1-be9137e47576 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:25.461040 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-92394e9a-b54a-46f9-9fc1-be9137e47576 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:25.578321 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=2 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:25.599268 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=6 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:25.711323 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-92394e9a-b54a-46f9-9fc1-be9137e47576 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:25.719481 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-92394e9a-b54a-46f9-9fc1-be9137e47576 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1264 microversion: 2.1 time: 0.272701 Aug 17 07:34:25.720352 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 439/883] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:25 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1264 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:26.743575 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d416277b-4e8b-4afb-924c-8a78361bca35 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:26.744846 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d416277b-4e8b-4afb-924c-8a78361bca35 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:26.765418 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=2 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:26.773026 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d416277b-4e8b-4afb-924c-8a78361bca35 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:26.773525 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d416277b-4e8b-4afb-924c-8a78361bca35 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:26.777481 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d416277b-4e8b-4afb-924c-8a78361bca35 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:26.778381 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d416277b-4e8b-4afb-924c-8a78361bca35 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:26.779004 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d416277b-4e8b-4afb-924c-8a78361bca35 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:26.779442 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d416277b-4e8b-4afb-924c-8a78361bca35 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:26.938844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d416277b-4e8b-4afb-924c-8a78361bca35 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:26.951812 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d416277b-4e8b-4afb-924c-8a78361bca35 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1264 microversion: 2.1 time: 0.213500 Aug 17 07:34:26.964422 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 445/884] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:26 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:27.973035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-3fec5f98-adfb-4766-9117-553bbf246890 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:27.973829 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-3fec5f98-adfb-4766-9117-553bbf246890 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:27.985350 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3fec5f98-adfb-4766-9117-553bbf246890 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:27.985868 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3fec5f98-adfb-4766-9117-553bbf246890 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:27.988412 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3fec5f98-adfb-4766-9117-553bbf246890 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:27.989154 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3fec5f98-adfb-4766-9117-553bbf246890 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:27.991810 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3fec5f98-adfb-4766-9117-553bbf246890 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:27.995632 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3fec5f98-adfb-4766-9117-553bbf246890 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:28.217343 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-3fec5f98-adfb-4766-9117-553bbf246890 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:28.225753 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-3fec5f98-adfb-4766-9117-553bbf246890 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1264 microversion: 2.1 time: 0.256896 Aug 17 07:34:28.227607 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 440/885] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:27 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1264 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:28.320155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-5593aa06-ffc7-4fb7-8fc2-53be50ab5329 req-0a54f70b-ab0f-4352-8b0f-6f3c478d55bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d7f0687-dd68-40b7-9f95-279726d56bc0", "name": "network-vif-plugged", "status": "completed", "tag": "e9ed906d-2552-4f27-bf24-b8cee4b20a07"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:34:28.341758 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-5593aa06-ffc7-4fb7-8fc2-53be50ab5329 req-0a54f70b-ab0f-4352-8b0f-6f3c478d55bd service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:28.342280 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-5593aa06-ffc7-4fb7-8fc2-53be50ab5329 req-0a54f70b-ab0f-4352-8b0f-6f3c478d55bd service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:28.342909 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-5593aa06-ffc7-4fb7-8fc2-53be50ab5329 req-0a54f70b-ab0f-4352-8b0f-6f3c478d55bd service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:28.361940 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-5593aa06-ffc7-4fb7-8fc2-53be50ab5329 req-0a54f70b-ab0f-4352-8b0f-6f3c478d55bd service nova] Creating event network-vif-plugged:e9ed906d-2552-4f27-bf24-b8cee4b20a07 for instance 5d7f0687-dd68-40b7-9f95-279726d56bc0 on hv-cinder-85312 Aug 17 07:34:28.368511 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-5593aa06-ffc7-4fb7-8fc2-53be50ab5329 req-0a54f70b-ab0f-4352-8b0f-6f3c478d55bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051821 Aug 17 07:34:28.369292 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 446/886] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:34:29.247904 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-cf8ed8f4-6678-48d3-8275-1eb2f2ed29d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:29.248634 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-cf8ed8f4-6678-48d3-8275-1eb2f2ed29d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:29.255650 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cf8ed8f4-6678-48d3-8275-1eb2f2ed29d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:29.256130 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cf8ed8f4-6678-48d3-8275-1eb2f2ed29d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:29.256565 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cf8ed8f4-6678-48d3-8275-1eb2f2ed29d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:29.257260 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cf8ed8f4-6678-48d3-8275-1eb2f2ed29d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:29.257716 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cf8ed8f4-6678-48d3-8275-1eb2f2ed29d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:29.258171 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-cf8ed8f4-6678-48d3-8275-1eb2f2ed29d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:29.406722 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-cf8ed8f4-6678-48d3-8275-1eb2f2ed29d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:29.414121 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-cf8ed8f4-6678-48d3-8275-1eb2f2ed29d0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1264 microversion: 2.1 time: 0.170081 Aug 17 07:34:29.414689 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 441/887] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:29 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:30.082308 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-df3649f5-d65e-4ae6-8c9e-bc9ea0bb5ccd tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1097070033", "imageRef": "37843ca7-b19a-44f1-acf3-e9432324d4b2", "flavorRef": "452", "networks": [{"uuid": "6e48e9dc-19d2-4ba4-8055-56c0d7f97e25"}]}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:34:30.152642 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.network.neutron [None req-df3649f5-d65e-4ae6-8c9e-bc9ea0bb5ccd tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] validate_networks() for [('6e48e9dc-19d2-4ba4-8055-56c0d7f97e25', None, None, None, None, None)] {{(pid=120835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:34:30.438825 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-e5685793-581e-4677-9c33-144291bfd659 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:30.441674 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-e5685793-581e-4677-9c33-144291bfd659 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:30.449447 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e5685793-581e-4677-9c33-144291bfd659 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:30.450902 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e5685793-581e-4677-9c33-144291bfd659 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:30.451541 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e5685793-581e-4677-9c33-144291bfd659 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:30.452620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e5685793-581e-4677-9c33-144291bfd659 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:30.453582 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e5685793-581e-4677-9c33-144291bfd659 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:30.454354 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e5685793-581e-4677-9c33-144291bfd659 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:30.626829 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-df3649f5-d65e-4ae6-8c9e-bc9ea0bb5ccd tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Flavor limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:34:30.627317 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-df3649f5-d65e-4ae6-8c9e-bc9ea0bb5ccd tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Image limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:34:30.628728 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-df3649f5-d65e-4ae6-8c9e-bc9ea0bb5ccd tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Flavor pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:34:30.629204 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-df3649f5-d65e-4ae6-8c9e-bc9ea0bb5ccd tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Image pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:34:30.629712 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-df3649f5-d65e-4ae6-8c9e-bc9ea0bb5ccd tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:34:30.639178 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-df3649f5-d65e-4ae6-8c9e-bc9ea0bb5ccd tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:30.639658 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-df3649f5-d65e-4ae6-8c9e-bc9ea0bb5ccd tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:30.640087 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-df3649f5-d65e-4ae6-8c9e-bc9ea0bb5ccd tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:30.640989 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-df3649f5-d65e-4ae6-8c9e-bc9ea0bb5ccd tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:30.641445 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-df3649f5-d65e-4ae6-8c9e-bc9ea0bb5ccd tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:30.641866 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-df3649f5-d65e-4ae6-8c9e-bc9ea0bb5ccd tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:30.659887 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-df3649f5-d65e-4ae6-8c9e-bc9ea0bb5ccd tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Getting quotas for project 2f7df2edf05f4cb597d67dfdea4f94e2. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:34:30.664640 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-df3649f5-d65e-4ae6-8c9e-bc9ea0bb5ccd tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Getting quotas for user 9dde4c5c4ce24c1a8b70334cd97c2d7f and project 2f7df2edf05f4cb597d67dfdea4f94e2. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:34:30.677817 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-df3649f5-d65e-4ae6-8c9e-bc9ea0bb5ccd tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Going to run 1 instances... {{(pid=120835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:34:30.680425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-df3649f5-d65e-4ae6-8c9e-bc9ea0bb5ccd tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37843ca7-b19a-44f1-acf3-e9432324d4b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:34:30.688828 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-e5685793-581e-4677-9c33-144291bfd659 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:30.698350 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-e5685793-581e-4677-9c33-144291bfd659 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1450 microversion: 2.1 time: 0.265021 Aug 17 07:34:30.699880 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 442/888] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:30 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1450 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:30.720459 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-096a89db-0feb-49ae-a4a3-9a870c3b4270 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:30.722774 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-096a89db-0feb-49ae-a4a3-9a870c3b4270 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:30.730094 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-096a89db-0feb-49ae-a4a3-9a870c3b4270 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:30.730801 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-096a89db-0feb-49ae-a4a3-9a870c3b4270 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:30.731406 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-096a89db-0feb-49ae-a4a3-9a870c3b4270 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:30.732847 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-096a89db-0feb-49ae-a4a3-9a870c3b4270 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:30.736950 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-df3649f5-d65e-4ae6-8c9e-bc9ea0bb5ccd tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666408 Aug 17 07:34:30.738197 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 447/889] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:34:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 07:34:30.746836 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-096a89db-0feb-49ae-a4a3-9a870c3b4270 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:30.747499 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-096a89db-0feb-49ae-a4a3-9a870c3b4270 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:30.750691 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e6ba216d-37d9-4d44-a34c-ed917d1ff416 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:30.751469 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e6ba216d-37d9-4d44-a34c-ed917d1ff416 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:30.824265 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-e6ba216d-37d9-4d44-a34c-ed917d1ff416 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:30.832837 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e6ba216d-37d9-4d44-a34c-ed917d1ff416 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7" status: 200 len: 1214 microversion: 2.1 time: 0.087889 Aug 17 07:34:30.833846 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 448/890] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:30 2022] GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:30.952723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-096a89db-0feb-49ae-a4a3-9a870c3b4270 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:30.960868 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-096a89db-0feb-49ae-a4a3-9a870c3b4270 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1450 microversion: 2.1 time: 0.244533 Aug 17 07:34:30.962991 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 443/891] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:30 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1450 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:34:31.854665 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c7fc14ef-dd7d-495e-8fb9-bee1788220b7 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:31.855282 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-c7fc14ef-dd7d-495e-8fb9-bee1788220b7 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:31.862683 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c7fc14ef-dd7d-495e-8fb9-bee1788220b7 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:31.863543 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c7fc14ef-dd7d-495e-8fb9-bee1788220b7 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:31.864913 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c7fc14ef-dd7d-495e-8fb9-bee1788220b7 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:31.866041 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c7fc14ef-dd7d-495e-8fb9-bee1788220b7 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:31.866666 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c7fc14ef-dd7d-495e-8fb9-bee1788220b7 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:31.867464 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c7fc14ef-dd7d-495e-8fb9-bee1788220b7 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:32.035826 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c7fc14ef-dd7d-495e-8fb9-bee1788220b7 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:32.046043 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-c7fc14ef-dd7d-495e-8fb9-bee1788220b7 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7" status: 200 len: 1266 microversion: 2.1 time: 0.195781 Aug 17 07:34:32.048032 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 449/892] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:31 2022] GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:33.070771 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-41dc5cc1-534c-4f2d-b5df-144d78583c77 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:33.072361 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-41dc5cc1-534c-4f2d-b5df-144d78583c77 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:33.082262 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-41dc5cc1-534c-4f2d-b5df-144d78583c77 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:33.083130 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-41dc5cc1-534c-4f2d-b5df-144d78583c77 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:33.083877 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-41dc5cc1-534c-4f2d-b5df-144d78583c77 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:33.084971 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-41dc5cc1-534c-4f2d-b5df-144d78583c77 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:33.085887 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-41dc5cc1-534c-4f2d-b5df-144d78583c77 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:33.086731 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-41dc5cc1-534c-4f2d-b5df-144d78583c77 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:33.274815 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-ef1966d6-b300-48f2-80de-fa66518fef4c req-9b1fbde7-cfa9-4b8a-b031-a42875f8bee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d7f0687-dd68-40b7-9f95-279726d56bc0", "tag": "e9ed906d-2552-4f27-bf24-b8cee4b20a07"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:34:33.293212 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-ef1966d6-b300-48f2-80de-fa66518fef4c req-9b1fbde7-cfa9-4b8a-b031-a42875f8bee7 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:33.293705 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-ef1966d6-b300-48f2-80de-fa66518fef4c req-9b1fbde7-cfa9-4b8a-b031-a42875f8bee7 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:33.294631 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-ef1966d6-b300-48f2-80de-fa66518fef4c req-9b1fbde7-cfa9-4b8a-b031-a42875f8bee7 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:33.316587 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-ef1966d6-b300-48f2-80de-fa66518fef4c req-9b1fbde7-cfa9-4b8a-b031-a42875f8bee7 service nova] Creating event network-changed:e9ed906d-2552-4f27-bf24-b8cee4b20a07 for instance 5d7f0687-dd68-40b7-9f95-279726d56bc0 on hv-cinder-85312 Aug 17 07:34:33.330084 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-ef1966d6-b300-48f2-80de-fa66518fef4c req-9b1fbde7-cfa9-4b8a-b031-a42875f8bee7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058724 Aug 17 07:34:33.330274 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-41dc5cc1-534c-4f2d-b5df-144d78583c77 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:33.340501 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 450/893] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:34:33.354123 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-41dc5cc1-534c-4f2d-b5df-144d78583c77 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7" status: 200 len: 1314 microversion: 2.1 time: 0.288490 Aug 17 07:34:33.354551 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 444/894] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:33 2022] GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:34.170833 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-0c68765f-6589-4ee2-b7fa-6421f4adf97f req-ef28a20b-ab7d-4a1c-b0b3-beb0bb0085e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7", "tag": "c63dbaa2-5312-4355-b6ec-e1eb1f9e0459"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:34:34.189499 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-0c68765f-6589-4ee2-b7fa-6421f4adf97f req-ef28a20b-ab7d-4a1c-b0b3-beb0bb0085e1 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:34.190711 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-0c68765f-6589-4ee2-b7fa-6421f4adf97f req-ef28a20b-ab7d-4a1c-b0b3-beb0bb0085e1 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:34.191471 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-0c68765f-6589-4ee2-b7fa-6421f4adf97f req-ef28a20b-ab7d-4a1c-b0b3-beb0bb0085e1 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:34.207013 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-0c68765f-6589-4ee2-b7fa-6421f4adf97f req-ef28a20b-ab7d-4a1c-b0b3-beb0bb0085e1 service nova] Creating event network-changed:c63dbaa2-5312-4355-b6ec-e1eb1f9e0459 for instance a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 on hv-cinder-85312 Aug 17 07:34:34.222777 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-0c68765f-6589-4ee2-b7fa-6421f4adf97f req-ef28a20b-ab7d-4a1c-b0b3-beb0bb0085e1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062189 Aug 17 07:34:34.223727 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 451/895] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:34:34.377258 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-bb11a7f1-223d-418b-9164-089017640d69 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:34.377860 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-bb11a7f1-223d-418b-9164-089017640d69 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:34.390225 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bb11a7f1-223d-418b-9164-089017640d69 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:34.391304 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bb11a7f1-223d-418b-9164-089017640d69 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:34.391995 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bb11a7f1-223d-418b-9164-089017640d69 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:34.393521 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bb11a7f1-223d-418b-9164-089017640d69 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:34.394310 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bb11a7f1-223d-418b-9164-089017640d69 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:34.395071 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-bb11a7f1-223d-418b-9164-089017640d69 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:34.617198 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-bb11a7f1-223d-418b-9164-089017640d69 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:34.638773 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-bb11a7f1-223d-418b-9164-089017640d69 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7" status: 200 len: 1314 microversion: 2.1 time: 0.264402 Aug 17 07:34:34.640091 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 445/896] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:34 2022] GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:35.661791 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c819b651-09b0-47d3-ab0f-c95fa00a87f5 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:35.662507 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-c819b651-09b0-47d3-ab0f-c95fa00a87f5 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:35.668631 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c819b651-09b0-47d3-ab0f-c95fa00a87f5 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:35.669103 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c819b651-09b0-47d3-ab0f-c95fa00a87f5 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:35.669534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c819b651-09b0-47d3-ab0f-c95fa00a87f5 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:35.670241 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c819b651-09b0-47d3-ab0f-c95fa00a87f5 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:35.670688 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c819b651-09b0-47d3-ab0f-c95fa00a87f5 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:35.671107 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c819b651-09b0-47d3-ab0f-c95fa00a87f5 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:35.808506 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c819b651-09b0-47d3-ab0f-c95fa00a87f5 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:35.816420 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-c819b651-09b0-47d3-ab0f-c95fa00a87f5 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7" status: 200 len: 1314 microversion: 2.1 time: 0.160022 Aug 17 07:34:35.816992 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 452/897] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:35 2022] GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:36.836739 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-74e63e99-8b80-485f-9376-6a2df3ff966f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:36.837291 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-74e63e99-8b80-485f-9376-6a2df3ff966f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:36.843827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-74e63e99-8b80-485f-9376-6a2df3ff966f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:36.844302 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-74e63e99-8b80-485f-9376-6a2df3ff966f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:36.844737 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-74e63e99-8b80-485f-9376-6a2df3ff966f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:36.846000 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-74e63e99-8b80-485f-9376-6a2df3ff966f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:36.846451 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-74e63e99-8b80-485f-9376-6a2df3ff966f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:36.846875 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-74e63e99-8b80-485f-9376-6a2df3ff966f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:36.982726 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-74e63e99-8b80-485f-9376-6a2df3ff966f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:36.990131 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-74e63e99-8b80-485f-9376-6a2df3ff966f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7" status: 200 len: 1314 microversion: 2.1 time: 0.157322 Aug 17 07:34:36.990690 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 446/898] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:36 2022] GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:38.010996 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-6eb7efe8-259d-4325-8e60-71fb9792798b tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:38.011619 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-6eb7efe8-259d-4325-8e60-71fb9792798b tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:38.018353 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6eb7efe8-259d-4325-8e60-71fb9792798b tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:38.018844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6eb7efe8-259d-4325-8e60-71fb9792798b tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:38.019284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6eb7efe8-259d-4325-8e60-71fb9792798b tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:38.019990 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6eb7efe8-259d-4325-8e60-71fb9792798b tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:38.020446 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6eb7efe8-259d-4325-8e60-71fb9792798b tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:38.020917 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6eb7efe8-259d-4325-8e60-71fb9792798b tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:38.151798 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-6eb7efe8-259d-4325-8e60-71fb9792798b tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:38.159471 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-6eb7efe8-259d-4325-8e60-71fb9792798b tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7" status: 200 len: 1314 microversion: 2.1 time: 0.152444 Aug 17 07:34:38.160038 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 453/899] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:38 2022] GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:39.179819 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9ffe674c-9bf5-45a7-93f9-13c7cc7688b0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:39.180425 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9ffe674c-9bf5-45a7-93f9-13c7cc7688b0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:39.186882 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ffe674c-9bf5-45a7-93f9-13c7cc7688b0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:39.187358 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ffe674c-9bf5-45a7-93f9-13c7cc7688b0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:39.187793 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ffe674c-9bf5-45a7-93f9-13c7cc7688b0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:39.188477 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ffe674c-9bf5-45a7-93f9-13c7cc7688b0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:39.188926 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ffe674c-9bf5-45a7-93f9-13c7cc7688b0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:39.189444 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9ffe674c-9bf5-45a7-93f9-13c7cc7688b0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:39.321955 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-9ffe674c-9bf5-45a7-93f9-13c7cc7688b0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:39.329361 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9ffe674c-9bf5-45a7-93f9-13c7cc7688b0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7" status: 200 len: 1314 microversion: 2.1 time: 0.153410 Aug 17 07:34:39.329924 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 447/900] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:39 2022] GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:40.351432 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-db53feda-8349-4819-862e-b1a292a783ed tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:40.351978 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-db53feda-8349-4819-862e-b1a292a783ed tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:40.358396 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-db53feda-8349-4819-862e-b1a292a783ed tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:40.358875 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-db53feda-8349-4819-862e-b1a292a783ed tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:40.359311 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-db53feda-8349-4819-862e-b1a292a783ed tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:40.359999 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-db53feda-8349-4819-862e-b1a292a783ed tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:40.360448 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-db53feda-8349-4819-862e-b1a292a783ed tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:40.360874 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-db53feda-8349-4819-862e-b1a292a783ed tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:40.491692 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-db53feda-8349-4819-862e-b1a292a783ed tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:40.499460 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-db53feda-8349-4819-862e-b1a292a783ed tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7" status: 200 len: 1314 microversion: 2.1 time: 0.152684 Aug 17 07:34:40.500039 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 454/901] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:40 2022] GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:40.640766 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-4b1bd1e4-6bae-46a3-8b58-aeabfe009f0a req-650b0389-e21d-4efe-bfaa-8b7f394b0fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7", "name": "network-vif-plugged", "status": "completed", "tag": "c63dbaa2-5312-4355-b6ec-e1eb1f9e0459"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:34:40.657938 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-4b1bd1e4-6bae-46a3-8b58-aeabfe009f0a req-650b0389-e21d-4efe-bfaa-8b7f394b0fd9 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:40.658169 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-4b1bd1e4-6bae-46a3-8b58-aeabfe009f0a req-650b0389-e21d-4efe-bfaa-8b7f394b0fd9 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:40.658528 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-4b1bd1e4-6bae-46a3-8b58-aeabfe009f0a req-650b0389-e21d-4efe-bfaa-8b7f394b0fd9 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:40.670483 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-4b1bd1e4-6bae-46a3-8b58-aeabfe009f0a req-650b0389-e21d-4efe-bfaa-8b7f394b0fd9 service nova] Creating event network-vif-plugged:c63dbaa2-5312-4355-b6ec-e1eb1f9e0459 for instance a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 on hv-cinder-85312 Aug 17 07:34:40.677896 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-4b1bd1e4-6bae-46a3-8b58-aeabfe009f0a req-650b0389-e21d-4efe-bfaa-8b7f394b0fd9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041180 Aug 17 07:34:40.678795 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 448/902] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:34:41.520081 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-dabed09b-b3f9-4a91-a416-acb34296a0d9 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:41.520732 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-dabed09b-b3f9-4a91-a416-acb34296a0d9 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:41.522689 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=2 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:41.523358 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=8 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:41.529552 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dabed09b-b3f9-4a91-a416-acb34296a0d9 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:41.530061 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dabed09b-b3f9-4a91-a416-acb34296a0d9 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:41.530502 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dabed09b-b3f9-4a91-a416-acb34296a0d9 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:41.531190 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dabed09b-b3f9-4a91-a416-acb34296a0d9 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:41.531646 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dabed09b-b3f9-4a91-a416-acb34296a0d9 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:41.532075 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dabed09b-b3f9-4a91-a416-acb34296a0d9 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:41.662641 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-dabed09b-b3f9-4a91-a416-acb34296a0d9 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:41.669973 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-dabed09b-b3f9-4a91-a416-acb34296a0d9 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7" status: 200 len: 1314 microversion: 2.1 time: 0.153763 Aug 17 07:34:41.670541 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 455/903] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:41 2022] GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:42.692712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-2782b21f-af60-4b6b-a412-eb869980d4ea tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:42.693420 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-2782b21f-af60-4b6b-a412-eb869980d4ea tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:42.700046 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2782b21f-af60-4b6b-a412-eb869980d4ea tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:42.700529 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2782b21f-af60-4b6b-a412-eb869980d4ea tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:42.700968 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2782b21f-af60-4b6b-a412-eb869980d4ea tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:42.701660 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2782b21f-af60-4b6b-a412-eb869980d4ea tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:42.702146 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2782b21f-af60-4b6b-a412-eb869980d4ea tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:42.702580 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2782b21f-af60-4b6b-a412-eb869980d4ea tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:42.833254 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-2782b21f-af60-4b6b-a412-eb869980d4ea tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:42.840689 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-2782b21f-af60-4b6b-a412-eb869980d4ea tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7" status: 200 len: 1497 microversion: 2.1 time: 0.153531 Aug 17 07:34:42.841249 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 449/904] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:42 2022] GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:43.293813 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-87fd4d59-fb00-4306-8235-c79e210b8bdf tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:43.294410 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-87fd4d59-fb00-4306-8235-c79e210b8bdf tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:43.297740 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:43.302372 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87fd4d59-fb00-4306-8235-c79e210b8bdf tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:43.303074 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87fd4d59-fb00-4306-8235-c79e210b8bdf tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:43.303516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87fd4d59-fb00-4306-8235-c79e210b8bdf tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:43.304224 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87fd4d59-fb00-4306-8235-c79e210b8bdf tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:43.304684 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87fd4d59-fb00-4306-8235-c79e210b8bdf tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:43.305116 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-87fd4d59-fb00-4306-8235-c79e210b8bdf tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:43.309798 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=69 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:43.332234 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-87fd4d59-fb00-4306-8235-c79e210b8bdf tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7] Going to try to terminate instance {{(pid=120835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:34:43.411960 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-87fd4d59-fb00-4306-8235-c79e210b8bdf tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7" status: 204 len: 0 microversion: 2.1 time: 0.122120 Aug 17 07:34:43.412871 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 456/905] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:34:43 2022] DELETE /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:34:43.422520 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-d73d3c7d-1680-4c58-b8f4-09401d8487de tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:43.424106 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-d73d3c7d-1680-4c58-b8f4-09401d8487de tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:43.427234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:43.432689 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d73d3c7d-1680-4c58-b8f4-09401d8487de tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:43.433256 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d73d3c7d-1680-4c58-b8f4-09401d8487de tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:43.433763 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d73d3c7d-1680-4c58-b8f4-09401d8487de tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:43.434603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d73d3c7d-1680-4c58-b8f4-09401d8487de tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:43.435135 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d73d3c7d-1680-4c58-b8f4-09401d8487de tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:43.435634 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d73d3c7d-1680-4c58-b8f4-09401d8487de tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:43.440682 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=85 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:43.575058 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-d73d3c7d-1680-4c58-b8f4-09401d8487de tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:43.581452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-d73d3c7d-1680-4c58-b8f4-09401d8487de tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7" status: 200 len: 1503 microversion: 2.1 time: 0.164284 Aug 17 07:34:43.582031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 450/906] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:43 2022] GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:44.602937 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-06fc4d5d-23a6-4faf-a448-99cbdbf16fb0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:44.604370 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-06fc4d5d-23a6-4faf-a448-99cbdbf16fb0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:44.611192 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-06fc4d5d-23a6-4faf-a448-99cbdbf16fb0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:44.611674 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-06fc4d5d-23a6-4faf-a448-99cbdbf16fb0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:44.612613 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-06fc4d5d-23a6-4faf-a448-99cbdbf16fb0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:44.613307 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-06fc4d5d-23a6-4faf-a448-99cbdbf16fb0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:44.613765 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-06fc4d5d-23a6-4faf-a448-99cbdbf16fb0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:44.614336 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-06fc4d5d-23a6-4faf-a448-99cbdbf16fb0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:44.746457 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-06fc4d5d-23a6-4faf-a448-99cbdbf16fb0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:44.754493 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-06fc4d5d-23a6-4faf-a448-99cbdbf16fb0 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7" status: 200 len: 1503 microversion: 2.1 time: 0.156188 Aug 17 07:34:44.755145 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 457/907] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:44 2022] GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:45.782356 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-99e2b8e0-3f24-41a8-8284-4f08ac10db0a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:45.783038 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-99e2b8e0-3f24-41a8-8284-4f08ac10db0a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:45.791573 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-99e2b8e0-3f24-41a8-8284-4f08ac10db0a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:45.792068 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-99e2b8e0-3f24-41a8-8284-4f08ac10db0a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:45.792511 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-99e2b8e0-3f24-41a8-8284-4f08ac10db0a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:45.793351 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-99e2b8e0-3f24-41a8-8284-4f08ac10db0a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:45.794092 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-99e2b8e0-3f24-41a8-8284-4f08ac10db0a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:45.795257 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-99e2b8e0-3f24-41a8-8284-4f08ac10db0a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:45.848154 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-84004474-2175-4fc9-924a-ceaafdc00b7f req-64707aa0-0929-4136-971e-74d271845698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7", "name": "network-vif-deleted", "tag": "c63dbaa2-5312-4355-b6ec-e1eb1f9e0459"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:34:45.861170 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-84004474-2175-4fc9-924a-ceaafdc00b7f req-64707aa0-0929-4136-971e-74d271845698 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:45.862788 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-84004474-2175-4fc9-924a-ceaafdc00b7f req-64707aa0-0929-4136-971e-74d271845698 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:45.863809 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-84004474-2175-4fc9-924a-ceaafdc00b7f req-64707aa0-0929-4136-971e-74d271845698 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:45.870772 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-99e2b8e0-3f24-41a8-8284-4f08ac10db0a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:45.877283 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-84004474-2175-4fc9-924a-ceaafdc00b7f req-64707aa0-0929-4136-971e-74d271845698 service nova] Creating event network-vif-deleted:c63dbaa2-5312-4355-b6ec-e1eb1f9e0459 for instance a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 on hv-cinder-85312 Aug 17 07:34:45.880342 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-99e2b8e0-3f24-41a8-8284-4f08ac10db0a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7" status: 200 len: 1461 microversion: 2.1 time: 0.107475 Aug 17 07:34:45.880932 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 451/908] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:45 2022] GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 => generated 1461 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:45.883223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-84004474-2175-4fc9-924a-ceaafdc00b7f req-64707aa0-0929-4136-971e-74d271845698 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038771 Aug 17 07:34:45.884293 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 458/909] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:34:46.902717 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-e7e7800e-9e4f-4063-a4de-a4b54d5cec9d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:46.903608 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-e7e7800e-9e4f-4063-a4de-a4b54d5cec9d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:46.910350 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e7e7800e-9e4f-4063-a4de-a4b54d5cec9d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:46.910922 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e7e7800e-9e4f-4063-a4de-a4b54d5cec9d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:46.911452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e7e7800e-9e4f-4063-a4de-a4b54d5cec9d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:46.912218 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e7e7800e-9e4f-4063-a4de-a4b54d5cec9d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:46.912669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e7e7800e-9e4f-4063-a4de-a4b54d5cec9d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:46.913086 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e7e7800e-9e4f-4063-a4de-a4b54d5cec9d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:46.926985 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-e7e7800e-9e4f-4063-a4de-a4b54d5cec9d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] HTTP exception thrown: Instance a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 could not be found. Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-e7e7800e-9e4f-4063-a4de-a4b54d5cec9d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Request method failure captured: Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 HTTP/1.1 Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JoDl8zGf73BQURcVDihhrMN5g19-d3hGxH0lzk4EQQ3xOdhkYbxk4ozeqaPUDxZXGT2_sKHuc_vKVCl1EGTTbIpy-sW9xjQ3AGBj2ZHaTFdbLX5ei0ZtBBXtFZdzOUkxcKOfWFPIVWP1_z1GXn6OT00Na-UPk_ZIsVp0-Gud_2KY_I Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 2f7df2edf05f4cb597d67dfdea4f94e2 Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-VolumesActionsTest-1388909818 Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:34:46.928705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:34:46.930452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f7df2edf05f4cb597d67dfdea4f94e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f7df2edf05f4cb597d67dfdea4f94e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f7df2edf05f4cb597d67dfdea4f94e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f7df2edf05f4cb597d67dfdea4f94e2"}]}] Aug 17 07:34:46.930452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-VolumesActionsTest-1388909818 Aug 17 07:34:46.930452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 2f7df2edf05f4cb597d67dfdea4f94e2 Aug 17 07:34:46.930452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-VolumesActionsTest-1388909818 Aug 17 07:34:46.930452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-VolumesActionsTest-1388909818-project Aug 17 07:34:46.930452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:34:46.930452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:34:46.930452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: 9dde4c5c4ce24c1a8b70334cd97c2d7f Aug 17 07:34:46.930452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-VolumesActionsTest-1388909818-project Aug 17 07:34:46.930452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:34:46.930452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 could not be found. Aug 17 07:34:46.930452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': 'a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7'} Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 could not be found. Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:34:46.931418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:34:46.932986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:34:46.932986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:34:46.932986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:34:46.932986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:34:46.932986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:34:46.932986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:34:46.932986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:34:46.932986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 could not be found. Aug 17 07:34:46.932986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:34:46.932986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:34:46.932986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:34:46.932986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:34:46.932986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:34:46.932986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:34:46.932986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:34:46.932986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:34:46.932986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 could not be found. Aug 17 07:34:46.932986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:34:46.934823 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-e7e7800e-9e4f-4063-a4de-a4b54d5cec9d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Returning 404 to user: Instance a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:34:46.934823 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-e7e7800e-9e4f-4063-a4de-a4b54d5cec9d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7" status: 404 len: 111 microversion: 2.1 time: 0.031365 Aug 17 07:34:46.934823 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 452/910] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:46 2022] GET /compute/v2.1/servers/a21d7bbc-ce0b-4fa7-a13e-5a31bd0575e7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:34:47.094385 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-0df1cdd2-922e-4c0d-8084-55a2150fb595 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1388863072", "imageRef": "37843ca7-b19a-44f1-acf3-e9432324d4b2", "flavorRef": "452", "networks": [{"uuid": "6e48e9dc-19d2-4ba4-8055-56c0d7f97e25"}]}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:34:47.148409 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.network.neutron [None req-0df1cdd2-922e-4c0d-8084-55a2150fb595 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] validate_networks() for [('6e48e9dc-19d2-4ba4-8055-56c0d7f97e25', None, None, None, None, None)] {{(pid=120835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:34:47.511772 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-0df1cdd2-922e-4c0d-8084-55a2150fb595 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Flavor limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:34:47.512199 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-0df1cdd2-922e-4c0d-8084-55a2150fb595 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Image limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:34:47.512892 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-0df1cdd2-922e-4c0d-8084-55a2150fb595 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Flavor pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:34:47.513307 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-0df1cdd2-922e-4c0d-8084-55a2150fb595 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Image pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:34:47.513723 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-0df1cdd2-922e-4c0d-8084-55a2150fb595 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:34:47.525427 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0df1cdd2-922e-4c0d-8084-55a2150fb595 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:47.526278 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0df1cdd2-922e-4c0d-8084-55a2150fb595 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:47.526724 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0df1cdd2-922e-4c0d-8084-55a2150fb595 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:47.527761 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0df1cdd2-922e-4c0d-8084-55a2150fb595 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:47.528245 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0df1cdd2-922e-4c0d-8084-55a2150fb595 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:47.528863 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0df1cdd2-922e-4c0d-8084-55a2150fb595 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:47.548535 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-0df1cdd2-922e-4c0d-8084-55a2150fb595 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Getting quotas for project 2f7df2edf05f4cb597d67dfdea4f94e2. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:34:47.552711 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-0df1cdd2-922e-4c0d-8084-55a2150fb595 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Getting quotas for user 9dde4c5c4ce24c1a8b70334cd97c2d7f and project 2f7df2edf05f4cb597d67dfdea4f94e2. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:34:47.563888 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-0df1cdd2-922e-4c0d-8084-55a2150fb595 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Going to run 1 instances... {{(pid=120835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:34:47.566700 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-0df1cdd2-922e-4c0d-8084-55a2150fb595 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37843ca7-b19a-44f1-acf3-e9432324d4b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:34:47.614733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-0df1cdd2-922e-4c0d-8084-55a2150fb595 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525050 Aug 17 07:34:47.615515 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 459/911] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:34:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 07:34:47.626601 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7a63f197-13dd-4a9a-a60b-452920582326 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:47.627218 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-7a63f197-13dd-4a9a-a60b-452920582326 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:47.685388 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-7a63f197-13dd-4a9a-a60b-452920582326 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:47.693725 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-7a63f197-13dd-4a9a-a60b-452920582326 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef" status: 200 len: 1214 microversion: 2.1 time: 0.070919 Aug 17 07:34:47.694402 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 453/912] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:47 2022] GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:34:48.720811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-5ecf809b-840c-4f53-bbec-09d72497786a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:48.721421 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-5ecf809b-840c-4f53-bbec-09d72497786a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:48.728380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5ecf809b-840c-4f53-bbec-09d72497786a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:48.728850 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5ecf809b-840c-4f53-bbec-09d72497786a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:48.729286 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5ecf809b-840c-4f53-bbec-09d72497786a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:48.730003 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5ecf809b-840c-4f53-bbec-09d72497786a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:48.730468 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5ecf809b-840c-4f53-bbec-09d72497786a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:48.730908 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5ecf809b-840c-4f53-bbec-09d72497786a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:48.794753 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-5ecf809b-840c-4f53-bbec-09d72497786a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:48.803519 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-5ecf809b-840c-4f53-bbec-09d72497786a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef" status: 200 len: 1218 microversion: 2.1 time: 0.086936 Aug 17 07:34:48.805852 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 460/913] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:48 2022] GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:49.829370 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a1e88621-d9be-4e64-9654-31124a575b6e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:49.830482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-a1e88621-d9be-4e64-9654-31124a575b6e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:49.839955 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a1e88621-d9be-4e64-9654-31124a575b6e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:49.840610 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a1e88621-d9be-4e64-9654-31124a575b6e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:49.841051 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a1e88621-d9be-4e64-9654-31124a575b6e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:49.841758 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a1e88621-d9be-4e64-9654-31124a575b6e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:49.842236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a1e88621-d9be-4e64-9654-31124a575b6e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:49.842900 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a1e88621-d9be-4e64-9654-31124a575b6e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:49.918312 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a1e88621-d9be-4e64-9654-31124a575b6e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:49.932637 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a1e88621-d9be-4e64-9654-31124a575b6e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef" status: 200 len: 1218 microversion: 2.1 time: 0.107689 Aug 17 07:34:49.932637 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 454/914] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:49 2022] GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:50.948552 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-fc6dc637-aea8-40b9-a9b1-190d036524ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:50.949212 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-fc6dc637-aea8-40b9-a9b1-190d036524ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:50.965388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fc6dc637-aea8-40b9-a9b1-190d036524ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:50.965884 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fc6dc637-aea8-40b9-a9b1-190d036524ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:50.966353 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fc6dc637-aea8-40b9-a9b1-190d036524ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:50.967070 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fc6dc637-aea8-40b9-a9b1-190d036524ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:50.967534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fc6dc637-aea8-40b9-a9b1-190d036524ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:50.967965 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-fc6dc637-aea8-40b9-a9b1-190d036524ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:51.133770 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-fc6dc637-aea8-40b9-a9b1-190d036524ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:51.141223 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-fc6dc637-aea8-40b9-a9b1-190d036524ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef" status: 200 len: 1314 microversion: 2.1 time: 0.196516 Aug 17 07:34:51.141792 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 461/915] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:50 2022] GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:51.672283 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-06bec9fd-b26f-4594-85c9-0aa4be170d29 req-02ace479-3ade-40d0-90d4-3ab4ecfef77c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86cafe0f-6464-4649-9885-3bcdf1abc2ef", "tag": "2d340811-0eae-445a-8965-167f68ed4b97"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:34:51.682452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-06bec9fd-b26f-4594-85c9-0aa4be170d29 req-02ace479-3ade-40d0-90d4-3ab4ecfef77c service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:51.683190 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-06bec9fd-b26f-4594-85c9-0aa4be170d29 req-02ace479-3ade-40d0-90d4-3ab4ecfef77c service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:51.683621 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-06bec9fd-b26f-4594-85c9-0aa4be170d29 req-02ace479-3ade-40d0-90d4-3ab4ecfef77c service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:51.695449 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-06bec9fd-b26f-4594-85c9-0aa4be170d29 req-02ace479-3ade-40d0-90d4-3ab4ecfef77c service nova] Creating event network-changed:2d340811-0eae-445a-8965-167f68ed4b97 for instance 86cafe0f-6464-4649-9885-3bcdf1abc2ef on hv-cinder-85312 Aug 17 07:34:51.701060 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-06bec9fd-b26f-4594-85c9-0aa4be170d29 req-02ace479-3ade-40d0-90d4-3ab4ecfef77c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032418 Aug 17 07:34:51.701656 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 455/916] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:34:52.131993 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-3b254b58-6aa8-4e49-8fd9-2aecc6e90cc4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-889806626", "imageRef": "37843ca7-b19a-44f1-acf3-e9432324d4b2", "flavorRef": "452", "networks": [{"uuid": "2cd251f7-2803-4e52-b15a-188824c49fb8"}]}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:34:52.164290 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a6ce08e0-4ba0-4446-999d-a1204644539d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:52.164994 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-a6ce08e0-4ba0-4446-999d-a1204644539d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:52.171278 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a6ce08e0-4ba0-4446-999d-a1204644539d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:52.171793 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a6ce08e0-4ba0-4446-999d-a1204644539d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:52.172398 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a6ce08e0-4ba0-4446-999d-a1204644539d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:52.173683 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a6ce08e0-4ba0-4446-999d-a1204644539d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:52.174190 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a6ce08e0-4ba0-4446-999d-a1204644539d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:52.175465 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a6ce08e0-4ba0-4446-999d-a1204644539d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:52.186473 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.network.neutron [None req-3b254b58-6aa8-4e49-8fd9-2aecc6e90cc4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] validate_networks() for [('2cd251f7-2803-4e52-b15a-188824c49fb8', None, None, None, None, None)] {{(pid=120835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:34:52.386584 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a6ce08e0-4ba0-4446-999d-a1204644539d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:52.397707 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a6ce08e0-4ba0-4446-999d-a1204644539d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef" status: 200 len: 1314 microversion: 2.1 time: 0.238759 Aug 17 07:34:52.412771 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 456/917] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:52 2022] GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:34:52.619308 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-3b254b58-6aa8-4e49-8fd9-2aecc6e90cc4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Flavor limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:34:52.619732 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-3b254b58-6aa8-4e49-8fd9-2aecc6e90cc4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Image limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:34:52.620207 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-3b254b58-6aa8-4e49-8fd9-2aecc6e90cc4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Flavor pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:34:52.620614 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-3b254b58-6aa8-4e49-8fd9-2aecc6e90cc4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Image pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:34:52.621025 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-3b254b58-6aa8-4e49-8fd9-2aecc6e90cc4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:34:52.629592 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3b254b58-6aa8-4e49-8fd9-2aecc6e90cc4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:52.630106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3b254b58-6aa8-4e49-8fd9-2aecc6e90cc4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:52.630546 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3b254b58-6aa8-4e49-8fd9-2aecc6e90cc4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:52.631271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3b254b58-6aa8-4e49-8fd9-2aecc6e90cc4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:52.631724 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3b254b58-6aa8-4e49-8fd9-2aecc6e90cc4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:52.632149 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-3b254b58-6aa8-4e49-8fd9-2aecc6e90cc4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:52.648789 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-3b254b58-6aa8-4e49-8fd9-2aecc6e90cc4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Getting quotas for project 25b64dfd6164420ba5ffe3b5c81585f2. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:34:52.652508 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-3b254b58-6aa8-4e49-8fd9-2aecc6e90cc4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Getting quotas for user 2001cc902b3644488a7d9c58cbf5eb58 and project 25b64dfd6164420ba5ffe3b5c81585f2. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:34:52.663684 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-3b254b58-6aa8-4e49-8fd9-2aecc6e90cc4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Going to run 1 instances... {{(pid=120835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:34:52.665747 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-3b254b58-6aa8-4e49-8fd9-2aecc6e90cc4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37843ca7-b19a-44f1-acf3-e9432324d4b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:34:52.709985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-3b254b58-6aa8-4e49-8fd9-2aecc6e90cc4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.582328 Aug 17 07:34:52.710887 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 462/918] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:34:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 07:34:52.722332 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-003dfa14-fc32-4e06-9693-b41b1449b7a1 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:52.722945 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-003dfa14-fc32-4e06-9693-b41b1449b7a1 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:52.774763 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-003dfa14-fc32-4e06-9693-b41b1449b7a1 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:52.781339 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-003dfa14-fc32-4e06-9693-b41b1449b7a1 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219" status: 200 len: 1218 microversion: 2.1 time: 0.063562 Aug 17 07:34:52.781915 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 457/919] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:52 2022] GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:53.420758 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-493d49d6-5111-4b89-918f-e1649b734b3a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:53.421371 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-493d49d6-5111-4b89-918f-e1649b734b3a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:53.428901 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-493d49d6-5111-4b89-918f-e1649b734b3a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:53.429388 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-493d49d6-5111-4b89-918f-e1649b734b3a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:53.429833 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-493d49d6-5111-4b89-918f-e1649b734b3a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:53.430583 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-493d49d6-5111-4b89-918f-e1649b734b3a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:53.431033 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-493d49d6-5111-4b89-918f-e1649b734b3a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:53.431462 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-493d49d6-5111-4b89-918f-e1649b734b3a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:53.568247 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-493d49d6-5111-4b89-918f-e1649b734b3a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:53.579293 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-493d49d6-5111-4b89-918f-e1649b734b3a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef" status: 200 len: 1314 microversion: 2.1 time: 0.162439 Aug 17 07:34:53.579811 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 463/920] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:53 2022] GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:53.804452 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-64ac1793-a31b-4373-a4af-cbce0eca77ac tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:53.806161 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-64ac1793-a31b-4373-a4af-cbce0eca77ac tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:53.814358 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-64ac1793-a31b-4373-a4af-cbce0eca77ac tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:53.815150 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-64ac1793-a31b-4373-a4af-cbce0eca77ac tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:53.815775 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-64ac1793-a31b-4373-a4af-cbce0eca77ac tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:53.816653 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-64ac1793-a31b-4373-a4af-cbce0eca77ac tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:53.817266 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-64ac1793-a31b-4373-a4af-cbce0eca77ac tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:53.817855 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-64ac1793-a31b-4373-a4af-cbce0eca77ac tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:53.887587 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-64ac1793-a31b-4373-a4af-cbce0eca77ac tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:53.896926 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-64ac1793-a31b-4373-a4af-cbce0eca77ac tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219" status: 200 len: 1276 microversion: 2.1 time: 0.098491 Aug 17 07:34:53.897641 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 458/921] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:53 2022] GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 => generated 1276 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:54.599832 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-56422009-6a54-41c2-bf59-70511c9b5150 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:54.600447 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-56422009-6a54-41c2-bf59-70511c9b5150 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:54.606879 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-56422009-6a54-41c2-bf59-70511c9b5150 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:54.607355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-56422009-6a54-41c2-bf59-70511c9b5150 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:54.607796 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-56422009-6a54-41c2-bf59-70511c9b5150 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:54.608480 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-56422009-6a54-41c2-bf59-70511c9b5150 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:54.608935 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-56422009-6a54-41c2-bf59-70511c9b5150 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:54.609361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-56422009-6a54-41c2-bf59-70511c9b5150 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:54.736512 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-56422009-6a54-41c2-bf59-70511c9b5150 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:54.744161 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-56422009-6a54-41c2-bf59-70511c9b5150 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef" status: 200 len: 1314 microversion: 2.1 time: 0.148182 Aug 17 07:34:54.744721 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 464/922] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:54 2022] GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:54.921087 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-5301b305-4f0a-46d4-b77c-cf27cb3979b4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:54.922265 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-5301b305-4f0a-46d4-b77c-cf27cb3979b4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:54.932903 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5301b305-4f0a-46d4-b77c-cf27cb3979b4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:54.933386 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5301b305-4f0a-46d4-b77c-cf27cb3979b4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:54.933831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5301b305-4f0a-46d4-b77c-cf27cb3979b4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:54.934568 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5301b305-4f0a-46d4-b77c-cf27cb3979b4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:54.935020 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5301b305-4f0a-46d4-b77c-cf27cb3979b4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:54.935444 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5301b305-4f0a-46d4-b77c-cf27cb3979b4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:55.061802 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-5301b305-4f0a-46d4-b77c-cf27cb3979b4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:55.069780 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-5301b305-4f0a-46d4-b77c-cf27cb3979b4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219" status: 200 len: 1318 microversion: 2.1 time: 0.152498 Aug 17 07:34:55.070367 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 459/923] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:54 2022] GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:55.765333 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-c28c39dd-68c1-4937-935f-3823644d450e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:55.765939 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-c28c39dd-68c1-4937-935f-3823644d450e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:55.772999 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c28c39dd-68c1-4937-935f-3823644d450e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:55.773476 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c28c39dd-68c1-4937-935f-3823644d450e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:55.773932 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c28c39dd-68c1-4937-935f-3823644d450e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:55.774643 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c28c39dd-68c1-4937-935f-3823644d450e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:55.775098 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c28c39dd-68c1-4937-935f-3823644d450e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:55.775524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-c28c39dd-68c1-4937-935f-3823644d450e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:55.905610 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-c28c39dd-68c1-4937-935f-3823644d450e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:55.914157 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-c28c39dd-68c1-4937-935f-3823644d450e tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef" status: 200 len: 1314 microversion: 2.1 time: 0.152829 Aug 17 07:34:55.914729 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 465/924] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:55 2022] GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:56.089934 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a7343827-c8e1-4c1d-a83f-53d2adf6efe9 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:56.090567 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-a7343827-c8e1-4c1d-a83f-53d2adf6efe9 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:56.096872 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a7343827-c8e1-4c1d-a83f-53d2adf6efe9 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:56.097357 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a7343827-c8e1-4c1d-a83f-53d2adf6efe9 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:56.097793 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a7343827-c8e1-4c1d-a83f-53d2adf6efe9 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:56.098513 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a7343827-c8e1-4c1d-a83f-53d2adf6efe9 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:56.098966 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a7343827-c8e1-4c1d-a83f-53d2adf6efe9 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:56.099391 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a7343827-c8e1-4c1d-a83f-53d2adf6efe9 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:56.225632 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a7343827-c8e1-4c1d-a83f-53d2adf6efe9 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:56.233097 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a7343827-c8e1-4c1d-a83f-53d2adf6efe9 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219" status: 200 len: 1318 microversion: 2.1 time: 0.147000 Aug 17 07:34:56.233673 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 460/925] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:56 2022] GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:56.629615 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-7886ae6b-69c2-48da-ac25-afaf1bdf37bf req-5afebba1-03ab-4819-98cf-28c58e7d0f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9638bd7-f534-4b78-b45a-d614d08be219", "tag": "fde4c17b-8069-4fc0-8678-cd428e8230eb"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:34:56.638872 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-7886ae6b-69c2-48da-ac25-afaf1bdf37bf req-5afebba1-03ab-4819-98cf-28c58e7d0f0f service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:56.639339 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-7886ae6b-69c2-48da-ac25-afaf1bdf37bf req-5afebba1-03ab-4819-98cf-28c58e7d0f0f service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:56.639781 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-7886ae6b-69c2-48da-ac25-afaf1bdf37bf req-5afebba1-03ab-4819-98cf-28c58e7d0f0f service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:56.650289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-7886ae6b-69c2-48da-ac25-afaf1bdf37bf req-5afebba1-03ab-4819-98cf-28c58e7d0f0f service nova] Creating event network-changed:fde4c17b-8069-4fc0-8678-cd428e8230eb for instance d9638bd7-f534-4b78-b45a-d614d08be219 on hv-cinder-85312 Aug 17 07:34:56.655054 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-7886ae6b-69c2-48da-ac25-afaf1bdf37bf req-5afebba1-03ab-4819-98cf-28c58e7d0f0f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029760 Aug 17 07:34:56.655815 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 466/926] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:34:56.934741 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-a74efd7e-4408-4f80-a244-2f5c43e149c4 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:56.935270 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-a74efd7e-4408-4f80-a244-2f5c43e149c4 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:56.941240 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a74efd7e-4408-4f80-a244-2f5c43e149c4 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:56.941722 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a74efd7e-4408-4f80-a244-2f5c43e149c4 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:56.942203 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a74efd7e-4408-4f80-a244-2f5c43e149c4 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:56.942895 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a74efd7e-4408-4f80-a244-2f5c43e149c4 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:56.943354 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a74efd7e-4408-4f80-a244-2f5c43e149c4 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:56.944057 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-a74efd7e-4408-4f80-a244-2f5c43e149c4 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:57.084110 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-a74efd7e-4408-4f80-a244-2f5c43e149c4 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:57.092467 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-a74efd7e-4408-4f80-a244-2f5c43e149c4 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef" status: 200 len: 1314 microversion: 2.1 time: 0.161078 Aug 17 07:34:57.093102 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 461/927] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:56 2022] GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:57.255468 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-2a3b5971-84e5-4db4-a315-2a8b17792d76 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:57.256163 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-2a3b5971-84e5-4db4-a315-2a8b17792d76 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:57.262485 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a3b5971-84e5-4db4-a315-2a8b17792d76 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:57.263006 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a3b5971-84e5-4db4-a315-2a8b17792d76 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:57.263478 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a3b5971-84e5-4db4-a315-2a8b17792d76 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:57.264187 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a3b5971-84e5-4db4-a315-2a8b17792d76 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:57.264641 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a3b5971-84e5-4db4-a315-2a8b17792d76 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:57.265068 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-2a3b5971-84e5-4db4-a315-2a8b17792d76 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:57.418291 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-2a3b5971-84e5-4db4-a315-2a8b17792d76 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:57.435277 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-2a3b5971-84e5-4db4-a315-2a8b17792d76 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219" status: 200 len: 1318 microversion: 2.1 time: 0.184776 Aug 17 07:34:57.436458 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 467/928] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:57 2022] GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:58.113582 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-aa58be45-8c3d-4bf7-abec-36757c58007d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:58.114511 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-aa58be45-8c3d-4bf7-abec-36757c58007d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:58.121517 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aa58be45-8c3d-4bf7-abec-36757c58007d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:58.122126 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aa58be45-8c3d-4bf7-abec-36757c58007d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:58.122567 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aa58be45-8c3d-4bf7-abec-36757c58007d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:58.123270 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aa58be45-8c3d-4bf7-abec-36757c58007d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:58.123825 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aa58be45-8c3d-4bf7-abec-36757c58007d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:58.124261 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aa58be45-8c3d-4bf7-abec-36757c58007d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:58.259754 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-aa58be45-8c3d-4bf7-abec-36757c58007d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:58.267557 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-aa58be45-8c3d-4bf7-abec-36757c58007d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef" status: 200 len: 1314 microversion: 2.1 time: 0.158336 Aug 17 07:34:58.268197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 462/929] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:58 2022] GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:58.455521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ee7f854b-0687-4379-b270-ad77687150a6 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:58.456140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-ee7f854b-0687-4379-b270-ad77687150a6 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:58.462699 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ee7f854b-0687-4379-b270-ad77687150a6 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:58.463172 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ee7f854b-0687-4379-b270-ad77687150a6 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:58.463600 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ee7f854b-0687-4379-b270-ad77687150a6 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:58.464284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ee7f854b-0687-4379-b270-ad77687150a6 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:58.464738 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ee7f854b-0687-4379-b270-ad77687150a6 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:58.465158 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ee7f854b-0687-4379-b270-ad77687150a6 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:58.597421 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ee7f854b-0687-4379-b270-ad77687150a6 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:58.606365 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-ee7f854b-0687-4379-b270-ad77687150a6 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219" status: 200 len: 1318 microversion: 2.1 time: 0.154444 Aug 17 07:34:58.607541 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 468/930] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:58 2022] GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:59.160097 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-0890fed6-7f8a-47c6-879e-54bd2139b57b req-7832c2b2-9ea4-4941-8d9b-dd9b6936b605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86cafe0f-6464-4649-9885-3bcdf1abc2ef", "name": "network-vif-plugged", "status": "completed", "tag": "2d340811-0eae-445a-8965-167f68ed4b97"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:34:59.169799 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-0890fed6-7f8a-47c6-879e-54bd2139b57b req-7832c2b2-9ea4-4941-8d9b-dd9b6936b605 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:59.170312 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-0890fed6-7f8a-47c6-879e-54bd2139b57b req-7832c2b2-9ea4-4941-8d9b-dd9b6936b605 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:59.170734 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-0890fed6-7f8a-47c6-879e-54bd2139b57b req-7832c2b2-9ea4-4941-8d9b-dd9b6936b605 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:59.182909 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-0890fed6-7f8a-47c6-879e-54bd2139b57b req-7832c2b2-9ea4-4941-8d9b-dd9b6936b605 service nova] Creating event network-vif-plugged:2d340811-0eae-445a-8965-167f68ed4b97 for instance 86cafe0f-6464-4649-9885-3bcdf1abc2ef on hv-cinder-85312 Aug 17 07:34:59.187595 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-0890fed6-7f8a-47c6-879e-54bd2139b57b req-7832c2b2-9ea4-4941-8d9b-dd9b6936b605 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031306 Aug 17 07:34:59.188197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 463/931] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:34:59.288057 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-8651c9b2-3cf1-4a48-ac41-4790c60c41f8 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:59.288889 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-8651c9b2-3cf1-4a48-ac41-4790c60c41f8 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:59.294884 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8651c9b2-3cf1-4a48-ac41-4790c60c41f8 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:59.295591 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8651c9b2-3cf1-4a48-ac41-4790c60c41f8 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:59.296221 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8651c9b2-3cf1-4a48-ac41-4790c60c41f8 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:59.300023 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8651c9b2-3cf1-4a48-ac41-4790c60c41f8 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:59.300023 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8651c9b2-3cf1-4a48-ac41-4790c60c41f8 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:59.300023 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8651c9b2-3cf1-4a48-ac41-4790c60c41f8 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:59.460248 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-8651c9b2-3cf1-4a48-ac41-4790c60c41f8 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:34:59.468115 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-8651c9b2-3cf1-4a48-ac41-4790c60c41f8 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef" status: 200 len: 1314 microversion: 2.1 time: 0.184699 Aug 17 07:34:59.468679 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 469/932] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:59 2022] GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:34:59.628422 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9c991aae-21cc-4c99-9faa-bf970c88365b tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:34:59.629122 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9c991aae-21cc-4c99-9faa-bf970c88365b tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:34:59.635131 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9c991aae-21cc-4c99-9faa-bf970c88365b tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:59.635604 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9c991aae-21cc-4c99-9faa-bf970c88365b tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:59.636035 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9c991aae-21cc-4c99-9faa-bf970c88365b tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:34:59.636708 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9c991aae-21cc-4c99-9faa-bf970c88365b tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:34:59.637151 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9c991aae-21cc-4c99-9faa-bf970c88365b tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:34:59.637566 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9c991aae-21cc-4c99-9faa-bf970c88365b tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:00.002123 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-9c991aae-21cc-4c99-9faa-bf970c88365b tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:00.009383 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9c991aae-21cc-4c99-9faa-bf970c88365b tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219" status: 200 len: 1318 microversion: 2.1 time: 0.385772 Aug 17 07:35:00.009936 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 464/933] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:34:59 2022] GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:00.488973 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-dabc69bb-f5c5-49be-ac57-55d810677ed6 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:00.489356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-dabc69bb-f5c5-49be-ac57-55d810677ed6 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:00.495962 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dabc69bb-f5c5-49be-ac57-55d810677ed6 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:00.496436 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dabc69bb-f5c5-49be-ac57-55d810677ed6 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:00.496866 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dabc69bb-f5c5-49be-ac57-55d810677ed6 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:00.497554 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dabc69bb-f5c5-49be-ac57-55d810677ed6 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:00.498033 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dabc69bb-f5c5-49be-ac57-55d810677ed6 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:00.498462 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-dabc69bb-f5c5-49be-ac57-55d810677ed6 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:00.636842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-dabc69bb-f5c5-49be-ac57-55d810677ed6 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:00.644876 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-dabc69bb-f5c5-49be-ac57-55d810677ed6 tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef" status: 200 len: 1497 microversion: 2.1 time: 0.160120 Aug 17 07:35:00.645437 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 470/934] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:00 2022] GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:01.030341 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-89ddfafe-7fa0-42a9-95a1-37caf1d1ce9a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:01.031062 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-89ddfafe-7fa0-42a9-95a1-37caf1d1ce9a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:01.037665 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-89ddfafe-7fa0-42a9-95a1-37caf1d1ce9a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:01.038472 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-89ddfafe-7fa0-42a9-95a1-37caf1d1ce9a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:01.039036 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-89ddfafe-7fa0-42a9-95a1-37caf1d1ce9a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:01.039836 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-89ddfafe-7fa0-42a9-95a1-37caf1d1ce9a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:01.040392 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-89ddfafe-7fa0-42a9-95a1-37caf1d1ce9a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:01.040995 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-89ddfafe-7fa0-42a9-95a1-37caf1d1ce9a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:01.176958 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-89ddfafe-7fa0-42a9-95a1-37caf1d1ce9a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:01.185105 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-89ddfafe-7fa0-42a9-95a1-37caf1d1ce9a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219" status: 200 len: 1318 microversion: 2.1 time: 0.159301 Aug 17 07:35:01.185680 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 465/935] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:01 2022] GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:01.288351 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-18a5bee7-9f4e-460d-b0a1-a0eab6032f9a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:01.288847 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-18a5bee7-9f4e-460d-b0a1-a0eab6032f9a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:01.294890 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-18a5bee7-9f4e-460d-b0a1-a0eab6032f9a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:01.295360 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-18a5bee7-9f4e-460d-b0a1-a0eab6032f9a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:01.295813 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-18a5bee7-9f4e-460d-b0a1-a0eab6032f9a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:01.296487 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-18a5bee7-9f4e-460d-b0a1-a0eab6032f9a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:01.296934 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-18a5bee7-9f4e-460d-b0a1-a0eab6032f9a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:01.297356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-18a5bee7-9f4e-460d-b0a1-a0eab6032f9a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:01.321919 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-18a5bee7-9f4e-460d-b0a1-a0eab6032f9a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] Going to try to terminate instance {{(pid=120835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:35:01.394466 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-18a5bee7-9f4e-460d-b0a1-a0eab6032f9a tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "DELETE /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef" status: 204 len: 0 microversion: 2.1 time: 0.110086 Aug 17 07:35:01.395058 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 471/936] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:35:01 2022] DELETE /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:35:01.405705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-dbc32f98-b574-48a5-a014-e9561228b83d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:01.406346 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-dbc32f98-b574-48a5-a014-e9561228b83d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:01.412734 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dbc32f98-b574-48a5-a014-e9561228b83d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:01.413216 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dbc32f98-b574-48a5-a014-e9561228b83d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:01.413655 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dbc32f98-b574-48a5-a014-e9561228b83d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:01.414373 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dbc32f98-b574-48a5-a014-e9561228b83d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:01.414828 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dbc32f98-b574-48a5-a014-e9561228b83d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:01.415255 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-dbc32f98-b574-48a5-a014-e9561228b83d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:01.542928 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-dbc32f98-b574-48a5-a014-e9561228b83d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:01.551055 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-dbc32f98-b574-48a5-a014-e9561228b83d tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef" status: 200 len: 1503 microversion: 2.1 time: 0.149571 Aug 17 07:35:01.551624 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 466/937] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:01 2022] GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:02.211779 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-025def14-0daf-4c63-b5f5-d788e2e06adc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:02.212486 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-025def14-0daf-4c63-b5f5-d788e2e06adc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:02.218859 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-025def14-0daf-4c63-b5f5-d788e2e06adc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:02.219337 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-025def14-0daf-4c63-b5f5-d788e2e06adc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:02.219778 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-025def14-0daf-4c63-b5f5-d788e2e06adc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:02.220470 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-025def14-0daf-4c63-b5f5-d788e2e06adc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:02.220919 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-025def14-0daf-4c63-b5f5-d788e2e06adc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:02.221346 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-025def14-0daf-4c63-b5f5-d788e2e06adc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:02.223952 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:02.350495 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-025def14-0daf-4c63-b5f5-d788e2e06adc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:02.358047 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-025def14-0daf-4c63-b5f5-d788e2e06adc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219" status: 200 len: 1318 microversion: 2.1 time: 0.150481 Aug 17 07:35:02.358605 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 472/938] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:02 2022] GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:02.572215 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-2ca39e24-3f02-483e-8fa4-33e4ef1e43ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:02.572872 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-2ca39e24-3f02-483e-8fa4-33e4ef1e43ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:02.579322 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2ca39e24-3f02-483e-8fa4-33e4ef1e43ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:02.579800 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2ca39e24-3f02-483e-8fa4-33e4ef1e43ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:02.580236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2ca39e24-3f02-483e-8fa4-33e4ef1e43ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:02.580921 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2ca39e24-3f02-483e-8fa4-33e4ef1e43ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:02.581372 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2ca39e24-3f02-483e-8fa4-33e4ef1e43ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:02.581793 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-2ca39e24-3f02-483e-8fa4-33e4ef1e43ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:02.711916 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-2ca39e24-3f02-483e-8fa4-33e4ef1e43ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:02.719385 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-2ca39e24-3f02-483e-8fa4-33e4ef1e43ab tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef" status: 200 len: 1503 microversion: 2.1 time: 0.151034 Aug 17 07:35:02.719945 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 467/939] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:02 2022] GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:03.186045 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-722d3470-c359-4873-bc3c-daf64bcf0b26 req-fd828f07-de67-4267-9f0a-16631f5a77d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9638bd7-f534-4b78-b45a-d614d08be219", "name": "network-vif-plugged", "status": "completed", "tag": "fde4c17b-8069-4fc0-8678-cd428e8230eb"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:35:03.191314 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=4 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:03.192072 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=12 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:03.198633 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-722d3470-c359-4873-bc3c-daf64bcf0b26 req-fd828f07-de67-4267-9f0a-16631f5a77d5 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:03.199082 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-722d3470-c359-4873-bc3c-daf64bcf0b26 req-fd828f07-de67-4267-9f0a-16631f5a77d5 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:03.199502 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-722d3470-c359-4873-bc3c-daf64bcf0b26 req-fd828f07-de67-4267-9f0a-16631f5a77d5 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:03.211525 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-722d3470-c359-4873-bc3c-daf64bcf0b26 req-fd828f07-de67-4267-9f0a-16631f5a77d5 service nova] Creating event network-vif-plugged:fde4c17b-8069-4fc0-8678-cd428e8230eb for instance d9638bd7-f534-4b78-b45a-d614d08be219 on hv-cinder-85312 Aug 17 07:35:03.216583 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-722d3470-c359-4873-bc3c-daf64bcf0b26 req-fd828f07-de67-4267-9f0a-16631f5a77d5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034445 Aug 17 07:35:03.217156 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 473/940] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:35:03.324586 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-4b08314c-b5e8-4e26-8f0a-5cd8848bcc1b req-4acdc1ed-ec3a-4b6c-9a3e-53a22e243a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86cafe0f-6464-4649-9885-3bcdf1abc2ef", "name": "network-vif-deleted", "tag": "2d340811-0eae-445a-8965-167f68ed4b97"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:35:03.334968 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=4 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:03.337181 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-4b08314c-b5e8-4e26-8f0a-5cd8848bcc1b req-4acdc1ed-ec3a-4b6c-9a3e-53a22e243a68 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:03.337654 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-4b08314c-b5e8-4e26-8f0a-5cd8848bcc1b req-4acdc1ed-ec3a-4b6c-9a3e-53a22e243a68 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:03.338106 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-4b08314c-b5e8-4e26-8f0a-5cd8848bcc1b req-4acdc1ed-ec3a-4b6c-9a3e-53a22e243a68 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:03.356325 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-4b08314c-b5e8-4e26-8f0a-5cd8848bcc1b req-4acdc1ed-ec3a-4b6c-9a3e-53a22e243a68 service nova] Creating event network-vif-deleted:2d340811-0eae-445a-8965-167f68ed4b97 for instance 86cafe0f-6464-4649-9885-3bcdf1abc2ef on hv-cinder-85312 Aug 17 07:35:03.362244 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-4b08314c-b5e8-4e26-8f0a-5cd8848bcc1b req-4acdc1ed-ec3a-4b6c-9a3e-53a22e243a68 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041567 Aug 17 07:35:03.363256 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 468/941] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:35:03.385851 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-43e1dbd1-3f13-4a66-9703-010086332427 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:03.387005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-43e1dbd1-3f13-4a66-9703-010086332427 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:03.396422 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-43e1dbd1-3f13-4a66-9703-010086332427 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:03.397155 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-43e1dbd1-3f13-4a66-9703-010086332427 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:03.397795 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-43e1dbd1-3f13-4a66-9703-010086332427 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:03.398753 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-43e1dbd1-3f13-4a66-9703-010086332427 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:03.399414 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-43e1dbd1-3f13-4a66-9703-010086332427 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:03.400048 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-43e1dbd1-3f13-4a66-9703-010086332427 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:03.551344 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-43e1dbd1-3f13-4a66-9703-010086332427 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:03.558904 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-43e1dbd1-3f13-4a66-9703-010086332427 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219" status: 200 len: 1318 microversion: 2.1 time: 0.182060 Aug 17 07:35:03.559475 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 474/942] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:03 2022] GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:03.740792 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f951b142-f62b-40ef-8ca7-dd3c9e6cd21f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:03.742453 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f951b142-f62b-40ef-8ca7-dd3c9e6cd21f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:03.749385 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f951b142-f62b-40ef-8ca7-dd3c9e6cd21f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:03.750085 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f951b142-f62b-40ef-8ca7-dd3c9e6cd21f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:03.750688 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f951b142-f62b-40ef-8ca7-dd3c9e6cd21f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:03.751563 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f951b142-f62b-40ef-8ca7-dd3c9e6cd21f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:03.752157 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f951b142-f62b-40ef-8ca7-dd3c9e6cd21f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:03.753238 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f951b142-f62b-40ef-8ca7-dd3c9e6cd21f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:03.788898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f951b142-f62b-40ef-8ca7-dd3c9e6cd21f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:03.789484 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f951b142-f62b-40ef-8ca7-dd3c9e6cd21f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:03.789889 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f951b142-f62b-40ef-8ca7-dd3c9e6cd21f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:03.790453 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.objects.instance [None req-f951b142-f62b-40ef-8ca7-dd3c9e6cd21f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lazy-loading 'fault' on Instance uuid 86cafe0f-6464-4649-9885-3bcdf1abc2ef {{(pid=120834) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:35:03.840438 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f951b142-f62b-40ef-8ca7-dd3c9e6cd21f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dde4c5c4ce24c1a8b70334cd97c2d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7df2edf05f4cb597d67dfdea4f94e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:03.849070 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f951b142-f62b-40ef-8ca7-dd3c9e6cd21f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef" status: 200 len: 1304 microversion: 2.1 time: 0.112854 Aug 17 07:35:03.849776 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 469/943] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:03 2022] GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:04.579918 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-8be0f513-26bf-436b-ab0b-fdf32a41c0ba tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:04.580613 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-8be0f513-26bf-436b-ab0b-fdf32a41c0ba tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:04.587183 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8be0f513-26bf-436b-ab0b-fdf32a41c0ba tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:04.587857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8be0f513-26bf-436b-ab0b-fdf32a41c0ba tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:04.588287 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8be0f513-26bf-436b-ab0b-fdf32a41c0ba tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:04.588972 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8be0f513-26bf-436b-ab0b-fdf32a41c0ba tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:04.589418 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8be0f513-26bf-436b-ab0b-fdf32a41c0ba tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:04.589835 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8be0f513-26bf-436b-ab0b-fdf32a41c0ba tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:04.729079 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-8be0f513-26bf-436b-ab0b-fdf32a41c0ba tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:04.736904 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-8be0f513-26bf-436b-ab0b-fdf32a41c0ba tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219" status: 200 len: 1318 microversion: 2.1 time: 0.160857 Aug 17 07:35:04.750523 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 475/944] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:04 2022] GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:04.871678 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-19bfff47-66ff-43a7-97df-3da67e42ba9f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:04.872908 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-19bfff47-66ff-43a7-97df-3da67e42ba9f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] [instance: 86cafe0f-6464-4649-9885-3bcdf1abc2ef] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:04.879810 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-19bfff47-66ff-43a7-97df-3da67e42ba9f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:04.880566 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-19bfff47-66ff-43a7-97df-3da67e42ba9f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:04.881163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-19bfff47-66ff-43a7-97df-3da67e42ba9f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:04.882065 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-19bfff47-66ff-43a7-97df-3da67e42ba9f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:04.882521 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-19bfff47-66ff-43a7-97df-3da67e42ba9f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:04.882942 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-19bfff47-66ff-43a7-97df-3da67e42ba9f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:04.899113 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-19bfff47-66ff-43a7-97df-3da67e42ba9f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] HTTP exception thrown: Instance 86cafe0f-6464-4649-9885-3bcdf1abc2ef could not be found. Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-19bfff47-66ff-43a7-97df-3da67e42ba9f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Request method failure captured: Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef HTTP/1.1 Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JoDl8zGf73BQURcVDihhrMN5g19-d3hGxH0lzk4EQQ3xOdhkYbxk4ozeqaPUDxZXGT2_sKHuc_vKVCl1EGTTbIpy-sW9xjQ3AGBj2ZHaTFdbLX5ei0ZtBBXtFZdzOUkxcKOfWFPIVWP1_z1GXn6OT00Na-UPk_ZIsVp0-Gud_2KY_I Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: 2f7df2edf05f4cb597d67dfdea4f94e2 Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-VolumesActionsTest-1388909818 Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:35:04.901723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:35:04.903533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f7df2edf05f4cb597d67dfdea4f94e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f7df2edf05f4cb597d67dfdea4f94e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f7df2edf05f4cb597d67dfdea4f94e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f7df2edf05f4cb597d67dfdea4f94e2"}]}] Aug 17 07:35:04.903533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-VolumesActionsTest-1388909818 Aug 17 07:35:04.903533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: 2f7df2edf05f4cb597d67dfdea4f94e2 Aug 17 07:35:04.903533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-VolumesActionsTest-1388909818 Aug 17 07:35:04.903533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-VolumesActionsTest-1388909818-project Aug 17 07:35:04.903533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:35:04.903533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:35:04.903533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: 9dde4c5c4ce24c1a8b70334cd97c2d7f Aug 17 07:35:04.903533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-VolumesActionsTest-1388909818-project Aug 17 07:35:04.903533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:35:04.903533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance 86cafe0f-6464-4649-9885-3bcdf1abc2ef could not be found. Aug 17 07:35:04.903533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': '86cafe0f-6464-4649-9885-3bcdf1abc2ef'} Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86cafe0f-6464-4649-9885-3bcdf1abc2ef could not be found. Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:35:04.904600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:35:04.906468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:35:04.906468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:35:04.906468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:35:04.906468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:35:04.906468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:35:04.906468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:35:04.906468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:35:04.906468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86cafe0f-6464-4649-9885-3bcdf1abc2ef could not be found. Aug 17 07:35:04.906468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:35:04.906468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:35:04.906468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:35:04.906468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:35:04.906468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:35:04.906468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:35:04.906468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:35:04.906468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:35:04.906468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86cafe0f-6464-4649-9885-3bcdf1abc2ef could not be found. Aug 17 07:35:04.906468 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:35:04.907692 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-19bfff47-66ff-43a7-97df-3da67e42ba9f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] Returning 404 to user: Instance 86cafe0f-6464-4649-9885-3bcdf1abc2ef could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:35:04.907692 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-19bfff47-66ff-43a7-97df-3da67e42ba9f tempest-VolumesActionsTest-1388909818 tempest-VolumesActionsTest-1388909818-project] 10.222.0.45 "GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef" status: 404 len: 111 microversion: 2.1 time: 0.036453 Aug 17 07:35:04.907692 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 470/945] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:04 2022] GET /compute/v2.1/servers/86cafe0f-6464-4649-9885-3bcdf1abc2ef => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:35:05.761755 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-4af36a40-957f-42d6-92bd-168b18b694ea tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:05.763063 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-4af36a40-957f-42d6-92bd-168b18b694ea tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:05.770787 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4af36a40-957f-42d6-92bd-168b18b694ea tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:05.771620 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4af36a40-957f-42d6-92bd-168b18b694ea tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:05.772294 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4af36a40-957f-42d6-92bd-168b18b694ea tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:05.773251 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4af36a40-957f-42d6-92bd-168b18b694ea tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:05.773923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4af36a40-957f-42d6-92bd-168b18b694ea tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:05.774596 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4af36a40-957f-42d6-92bd-168b18b694ea tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:06.069073 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-4af36a40-957f-42d6-92bd-168b18b694ea tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:06.077114 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-4af36a40-957f-42d6-92bd-168b18b694ea tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219" status: 200 len: 1507 microversion: 2.1 time: 0.321805 Aug 17 07:35:06.077695 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 476/946] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:05 2022] GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 => generated 1507 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:15.666710 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=47 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:15.669284 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=95 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:15.898970 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-88d22269-dfc6-46b7-b5a2-5a83fb092b56 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Action: 'create', calling method: .version_select at 0x7f30ac35fc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1335859032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFY4/ldHU2T3XokAgo0AfrmMw/aabQ1Qvk3F9oBqifVpStdzzNTV+hQNO8xzO0T+K3ngLcHlyq0HweiG5Yfx2kurB97nsspCf0XAcN0JrbQdsy5u0b+jBnBwfNwPRt33Q=="}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:35:15.918208 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-88d22269-dfc6-46b7-b5a2-5a83fb092b56 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Getting quotas for project 7eaf872dd2f4428ca13c52c4a06f7bdd. Resources: {'key_pairs'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:35:15.925374 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-88d22269-dfc6-46b7-b5a2-5a83fb092b56 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Getting quotas for user 61223d3bd5d84a88bed479f055186dbf and project 7eaf872dd2f4428ca13c52c4a06f7bdd. Resources: {'key_pairs'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:35:15.955986 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-88d22269-dfc6-46b7-b5a2-5a83fb092b56 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.294516 Aug 17 07:35:15.956595 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 471/947] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 17 07:35:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:35:39.871447 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a25e8420-3318-422e-9fdd-0a6d86718691 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3b3d295-cc71-4309-abb3-db1b4df7e28b", "device": "/dev/sdb"}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:35:39.874408 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a25e8420-3318-422e-9fdd-0a6d86718691 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:39.876834 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:39.877512 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=25 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:39.883183 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a25e8420-3318-422e-9fdd-0a6d86718691 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:39.883710 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a25e8420-3318-422e-9fdd-0a6d86718691 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:39.884191 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a25e8420-3318-422e-9fdd-0a6d86718691 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:39.884879 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a25e8420-3318-422e-9fdd-0a6d86718691 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:39.885377 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a25e8420-3318-422e-9fdd-0a6d86718691 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:39.885845 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a25e8420-3318-422e-9fdd-0a6d86718691 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:40.123899 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a25e8420-3318-422e-9fdd-0a6d86718691 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "POST /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256831 Aug 17 07:35:40.124532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 477/948] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 17 07:35:39 2022] POST /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:35:43.618439 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=4 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:43.619489 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:43.623392 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-aacf233b-6f85-4e2d-842e-7adf47dbc88c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1113702775", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1335859032", "security_groups": [{"name": "tempest-secgroup-smoke-702706816"}], "networks": [{"uuid": "114fa4b7-fcdf-44b8-87b0-ce6bce751876"}], "block_device_mapping_v2": [{"uuid": "4bef254c-189e-456c-929d-832bbe60b7bd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:35:43.737142 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.network.neutron [None req-aacf233b-6f85-4e2d-842e-7adf47dbc88c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] validate_networks() for [('114fa4b7-fcdf-44b8-87b0-ce6bce751876', None, None, None, None, None)] {{(pid=120834) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:35:44.096528 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-aacf233b-6f85-4e2d-842e-7adf47dbc88c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Flavor limits 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:35:44.096917 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-aacf233b-6f85-4e2d-842e-7adf47dbc88c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Image limits 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:35:44.097393 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-aacf233b-6f85-4e2d-842e-7adf47dbc88c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Flavor pref 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:35:44.097802 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-aacf233b-6f85-4e2d-842e-7adf47dbc88c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Image pref 0:0:0 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:35:44.098265 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.virt.hardware [None req-aacf233b-6f85-4e2d-842e-7adf47dbc88c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120834) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:35:44.107448 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aacf233b-6f85-4e2d-842e-7adf47dbc88c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:44.107927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aacf233b-6f85-4e2d-842e-7adf47dbc88c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:44.108359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aacf233b-6f85-4e2d-842e-7adf47dbc88c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:44.109078 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aacf233b-6f85-4e2d-842e-7adf47dbc88c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:44.109530 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aacf233b-6f85-4e2d-842e-7adf47dbc88c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:44.109955 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-aacf233b-6f85-4e2d-842e-7adf47dbc88c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:44.126929 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-aacf233b-6f85-4e2d-842e-7adf47dbc88c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Getting quotas for project 7eaf872dd2f4428ca13c52c4a06f7bdd. Resources: {'ram', 'cores', 'instances'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:35:44.130824 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.quota [None req-aacf233b-6f85-4e2d-842e-7adf47dbc88c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Getting quotas for user 61223d3bd5d84a88bed479f055186dbf and project 7eaf872dd2f4428ca13c52c4a06f7bdd. Resources: {'ram', 'cores', 'instances'} {{(pid=120834) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:35:44.186137 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-aacf233b-6f85-4e2d-842e-7adf47dbc88c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Going to run 1 instances... {{(pid=120834) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:35:44.188310 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-aacf233b-6f85-4e2d-842e-7adf47dbc88c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4bef254c-189e-456c-929d-832bbe60b7bd',volume_size=None,volume_type=None)] {{(pid=120834) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:35:44.314461 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-aacf233b-6f85-4e2d-842e-7adf47dbc88c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.697595 Aug 17 07:35:44.315399 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 472/949] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:35:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 07:35:44.326841 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-495e1156-1026-4ab9-b464-cb1ec6f88401 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:44.327548 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-495e1156-1026-4ab9-b464-cb1ec6f88401 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:44.382023 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-495e1156-1026-4ab9-b464-cb1ec6f88401 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:44.388995 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-495e1156-1026-4ab9-b464-cb1ec6f88401 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1089 microversion: 2.1 time: 0.066837 Aug 17 07:35:44.389560 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 478/950] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:44 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:45.410109 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-720686e4-2df3-4923-9654-355555bc5b8a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:45.410719 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-720686e4-2df3-4923-9654-355555bc5b8a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:45.417815 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-720686e4-2df3-4923-9654-355555bc5b8a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:45.418321 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-720686e4-2df3-4923-9654-355555bc5b8a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:45.418751 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-720686e4-2df3-4923-9654-355555bc5b8a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:45.419438 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-720686e4-2df3-4923-9654-355555bc5b8a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:45.419892 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-720686e4-2df3-4923-9654-355555bc5b8a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:45.420300 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-720686e4-2df3-4923-9654-355555bc5b8a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:45.496525 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-720686e4-2df3-4923-9654-355555bc5b8a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:45.504814 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-720686e4-2df3-4923-9654-355555bc5b8a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1195 microversion: 2.1 time: 0.098844 Aug 17 07:35:45.505783 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 473/951] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:45 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1195 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:46.526377 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-467f3c40-6da7-415f-ae9a-4e161491041c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:46.526983 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-467f3c40-6da7-415f-ae9a-4e161491041c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:46.535056 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-467f3c40-6da7-415f-ae9a-4e161491041c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:46.535932 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-467f3c40-6da7-415f-ae9a-4e161491041c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:46.536353 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-467f3c40-6da7-415f-ae9a-4e161491041c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:46.537535 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-467f3c40-6da7-415f-ae9a-4e161491041c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:46.538198 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-467f3c40-6da7-415f-ae9a-4e161491041c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:46.538799 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-467f3c40-6da7-415f-ae9a-4e161491041c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:46.687889 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-467f3c40-6da7-415f-ae9a-4e161491041c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:46.695437 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-467f3c40-6da7-415f-ae9a-4e161491041c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1272 microversion: 2.1 time: 0.173112 Aug 17 07:35:46.695999 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 479/952] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:46 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:46.761289 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-23d0273d-2c8e-4eab-81a2-566423bcb029 req-ddbf2c64-d240-49b3-8bf1-d383f67e1954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e628869-f998-4c45-a905-3dd276ca94f5", "tag": "9baee402-152f-4aa2-a956-c2704e4b760c"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:35:46.771127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-23d0273d-2c8e-4eab-81a2-566423bcb029 req-ddbf2c64-d240-49b3-8bf1-d383f67e1954 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:46.772147 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-23d0273d-2c8e-4eab-81a2-566423bcb029 req-ddbf2c64-d240-49b3-8bf1-d383f67e1954 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:46.772590 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-23d0273d-2c8e-4eab-81a2-566423bcb029 req-ddbf2c64-d240-49b3-8bf1-d383f67e1954 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:46.783411 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-23d0273d-2c8e-4eab-81a2-566423bcb029 req-ddbf2c64-d240-49b3-8bf1-d383f67e1954 service nova] Creating event network-changed:9baee402-152f-4aa2-a956-c2704e4b760c for instance 4e628869-f998-4c45-a905-3dd276ca94f5 on hv-cinder-85312 Aug 17 07:35:46.789051 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-23d0273d-2c8e-4eab-81a2-566423bcb029 req-ddbf2c64-d240-49b3-8bf1-d383f67e1954 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032239 Aug 17 07:35:46.789634 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 474/953] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:35:47.715038 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-0e7f7665-4efa-4889-8bf2-6a855280372c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:47.715802 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-0e7f7665-4efa-4889-8bf2-6a855280372c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:47.722226 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0e7f7665-4efa-4889-8bf2-6a855280372c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:47.722711 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0e7f7665-4efa-4889-8bf2-6a855280372c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:47.723152 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0e7f7665-4efa-4889-8bf2-6a855280372c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:47.723847 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0e7f7665-4efa-4889-8bf2-6a855280372c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:47.724310 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0e7f7665-4efa-4889-8bf2-6a855280372c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:47.725242 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0e7f7665-4efa-4889-8bf2-6a855280372c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:47.864002 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-0e7f7665-4efa-4889-8bf2-6a855280372c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:47.871893 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-0e7f7665-4efa-4889-8bf2-6a855280372c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1272 microversion: 2.1 time: 0.160701 Aug 17 07:35:47.872466 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 480/954] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:47 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:48.892938 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-58d03f73-b6bd-42b5-bf39-e5c302891a36 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:48.893634 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-58d03f73-b6bd-42b5-bf39-e5c302891a36 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:48.900772 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-58d03f73-b6bd-42b5-bf39-e5c302891a36 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:48.901247 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-58d03f73-b6bd-42b5-bf39-e5c302891a36 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:48.901680 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-58d03f73-b6bd-42b5-bf39-e5c302891a36 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:48.902402 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-58d03f73-b6bd-42b5-bf39-e5c302891a36 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:48.902855 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-58d03f73-b6bd-42b5-bf39-e5c302891a36 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:48.903280 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-58d03f73-b6bd-42b5-bf39-e5c302891a36 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:49.035218 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-58d03f73-b6bd-42b5-bf39-e5c302891a36 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:49.043148 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-58d03f73-b6bd-42b5-bf39-e5c302891a36 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1272 microversion: 2.1 time: 0.154362 Aug 17 07:35:49.043704 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 475/955] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:48 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:50.063558 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-63d7f531-b14e-4c43-9264-47b8ed336b04 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:50.064196 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-63d7f531-b14e-4c43-9264-47b8ed336b04 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:50.070912 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-63d7f531-b14e-4c43-9264-47b8ed336b04 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:50.071389 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-63d7f531-b14e-4c43-9264-47b8ed336b04 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:50.071825 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-63d7f531-b14e-4c43-9264-47b8ed336b04 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:50.072510 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-63d7f531-b14e-4c43-9264-47b8ed336b04 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:50.072963 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-63d7f531-b14e-4c43-9264-47b8ed336b04 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:50.073391 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-63d7f531-b14e-4c43-9264-47b8ed336b04 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:50.213624 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-63d7f531-b14e-4c43-9264-47b8ed336b04 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:50.221087 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-63d7f531-b14e-4c43-9264-47b8ed336b04 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1272 microversion: 2.1 time: 0.161431 Aug 17 07:35:50.221673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 481/956] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:50 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:51.242857 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1b994a23-912f-4a84-b53e-42b38e3a739a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:51.243464 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-1b994a23-912f-4a84-b53e-42b38e3a739a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:51.249795 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1b994a23-912f-4a84-b53e-42b38e3a739a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:51.250300 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1b994a23-912f-4a84-b53e-42b38e3a739a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:51.250735 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1b994a23-912f-4a84-b53e-42b38e3a739a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:51.251418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1b994a23-912f-4a84-b53e-42b38e3a739a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:51.251867 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1b994a23-912f-4a84-b53e-42b38e3a739a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:51.252293 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1b994a23-912f-4a84-b53e-42b38e3a739a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:51.387346 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-1b994a23-912f-4a84-b53e-42b38e3a739a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:51.395082 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-1b994a23-912f-4a84-b53e-42b38e3a739a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1272 microversion: 2.1 time: 0.156905 Aug 17 07:35:51.395609 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 476/957] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:51 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:52.414806 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-59d7b2d6-b80c-4587-9914-08f58f0b37cc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:52.415417 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-59d7b2d6-b80c-4587-9914-08f58f0b37cc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:52.422072 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-59d7b2d6-b80c-4587-9914-08f58f0b37cc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:52.422559 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-59d7b2d6-b80c-4587-9914-08f58f0b37cc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:52.422996 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-59d7b2d6-b80c-4587-9914-08f58f0b37cc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:52.423690 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-59d7b2d6-b80c-4587-9914-08f58f0b37cc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:52.424185 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-59d7b2d6-b80c-4587-9914-08f58f0b37cc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:52.424614 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-59d7b2d6-b80c-4587-9914-08f58f0b37cc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:52.552974 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-59d7b2d6-b80c-4587-9914-08f58f0b37cc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:52.560429 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-59d7b2d6-b80c-4587-9914-08f58f0b37cc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1272 microversion: 2.1 time: 0.149588 Aug 17 07:35:52.561000 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 482/958] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:52 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:53.580891 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-090bec70-b4b2-40f0-9db4-ac8434cba637 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:53.581576 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-090bec70-b4b2-40f0-9db4-ac8434cba637 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:53.588552 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-090bec70-b4b2-40f0-9db4-ac8434cba637 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:53.589107 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-090bec70-b4b2-40f0-9db4-ac8434cba637 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:53.589619 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-090bec70-b4b2-40f0-9db4-ac8434cba637 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:53.590414 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-090bec70-b4b2-40f0-9db4-ac8434cba637 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:53.590937 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-090bec70-b4b2-40f0-9db4-ac8434cba637 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:53.591455 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-090bec70-b4b2-40f0-9db4-ac8434cba637 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:53.726811 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-090bec70-b4b2-40f0-9db4-ac8434cba637 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:53.734307 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-090bec70-b4b2-40f0-9db4-ac8434cba637 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1260 microversion: 2.1 time: 0.157607 Aug 17 07:35:53.734869 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 477/959] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:53 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:54.755719 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-afcbdae1-69ed-456c-bad5-085bba0588fe tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:54.756332 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-afcbdae1-69ed-456c-bad5-085bba0588fe tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:54.758767 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=2 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:54.764055 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-afcbdae1-69ed-456c-bad5-085bba0588fe tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:54.764533 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-afcbdae1-69ed-456c-bad5-085bba0588fe tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:54.764966 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-afcbdae1-69ed-456c-bad5-085bba0588fe tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:54.765660 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-afcbdae1-69ed-456c-bad5-085bba0588fe tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:54.766142 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-afcbdae1-69ed-456c-bad5-085bba0588fe tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:54.766572 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-afcbdae1-69ed-456c-bad5-085bba0588fe tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:54.897442 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-afcbdae1-69ed-456c-bad5-085bba0588fe tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:54.905499 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-afcbdae1-69ed-456c-bad5-085bba0588fe tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1260 microversion: 2.1 time: 0.153580 Aug 17 07:35:54.906100 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 483/960] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:54 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:55.925777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b8c4e619-cebc-4c19-a503-cff594e38167 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:55.926409 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-b8c4e619-cebc-4c19-a503-cff594e38167 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:55.928337 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=2 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:55.929618 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=6 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:55.936762 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b8c4e619-cebc-4c19-a503-cff594e38167 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:55.937233 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b8c4e619-cebc-4c19-a503-cff594e38167 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:55.938028 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b8c4e619-cebc-4c19-a503-cff594e38167 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:55.938713 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b8c4e619-cebc-4c19-a503-cff594e38167 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:55.939161 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b8c4e619-cebc-4c19-a503-cff594e38167 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:55.939584 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b8c4e619-cebc-4c19-a503-cff594e38167 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:56.067930 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-b8c4e619-cebc-4c19-a503-cff594e38167 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:56.076076 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b8c4e619-cebc-4c19-a503-cff594e38167 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1260 microversion: 2.1 time: 0.154132 Aug 17 07:35:56.076642 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 478/961] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:55 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:57.097067 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d7940b1c-48e6-432a-93d8-c472cedd69bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:57.097687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d7940b1c-48e6-432a-93d8-c472cedd69bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:57.104170 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d7940b1c-48e6-432a-93d8-c472cedd69bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:57.104652 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d7940b1c-48e6-432a-93d8-c472cedd69bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:57.105101 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d7940b1c-48e6-432a-93d8-c472cedd69bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:57.105795 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d7940b1c-48e6-432a-93d8-c472cedd69bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:57.106285 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d7940b1c-48e6-432a-93d8-c472cedd69bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:57.106717 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d7940b1c-48e6-432a-93d8-c472cedd69bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:57.246692 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-d7940b1c-48e6-432a-93d8-c472cedd69bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:57.254435 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d7940b1c-48e6-432a-93d8-c472cedd69bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1260 microversion: 2.1 time: 0.161192 Aug 17 07:35:57.268684 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 484/962] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:57 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:58.276306 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-432445ad-0b42-46bf-afbd-b762fc0bfd22 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:58.276910 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-432445ad-0b42-46bf-afbd-b762fc0bfd22 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:58.283322 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-432445ad-0b42-46bf-afbd-b762fc0bfd22 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:58.283800 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-432445ad-0b42-46bf-afbd-b762fc0bfd22 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:58.284231 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-432445ad-0b42-46bf-afbd-b762fc0bfd22 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:58.284916 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-432445ad-0b42-46bf-afbd-b762fc0bfd22 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:58.285371 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-432445ad-0b42-46bf-afbd-b762fc0bfd22 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:58.285794 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-432445ad-0b42-46bf-afbd-b762fc0bfd22 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:58.416660 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-432445ad-0b42-46bf-afbd-b762fc0bfd22 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:58.424142 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-432445ad-0b42-46bf-afbd-b762fc0bfd22 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1260 microversion: 2.1 time: 0.152342 Aug 17 07:35:58.424705 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 479/963] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:58 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:35:59.444582 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-25587550-1cb9-46c1-a045-16d3e05222c0 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:35:59.445232 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-25587550-1cb9-46c1-a045-16d3e05222c0 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:35:59.451583 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-25587550-1cb9-46c1-a045-16d3e05222c0 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:59.452063 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-25587550-1cb9-46c1-a045-16d3e05222c0 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:59.452498 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-25587550-1cb9-46c1-a045-16d3e05222c0 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:59.453179 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-25587550-1cb9-46c1-a045-16d3e05222c0 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:35:59.453634 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-25587550-1cb9-46c1-a045-16d3e05222c0 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:35:59.454087 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-25587550-1cb9-46c1-a045-16d3e05222c0 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:35:59.586886 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-25587550-1cb9-46c1-a045-16d3e05222c0 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:35:59.594304 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-25587550-1cb9-46c1-a045-16d3e05222c0 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1260 microversion: 2.1 time: 0.153741 Aug 17 07:35:59.594866 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 485/964] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:35:59 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:00.615333 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-23db1fd9-f03e-4415-81e3-72a64da1ae14 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:00.615814 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-23db1fd9-f03e-4415-81e3-72a64da1ae14 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:00.624704 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-23db1fd9-f03e-4415-81e3-72a64da1ae14 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:00.624704 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-23db1fd9-f03e-4415-81e3-72a64da1ae14 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:00.624704 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-23db1fd9-f03e-4415-81e3-72a64da1ae14 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:00.625052 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-23db1fd9-f03e-4415-81e3-72a64da1ae14 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:00.625508 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-23db1fd9-f03e-4415-81e3-72a64da1ae14 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:00.625930 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-23db1fd9-f03e-4415-81e3-72a64da1ae14 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:00.759325 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-23db1fd9-f03e-4415-81e3-72a64da1ae14 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:00.768052 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-23db1fd9-f03e-4415-81e3-72a64da1ae14 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1260 microversion: 2.1 time: 0.156787 Aug 17 07:36:00.768575 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 480/965] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:00 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:36:01.789207 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a996f5d2-ce12-460e-be0c-175c29427c9f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:01.790135 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a996f5d2-ce12-460e-be0c-175c29427c9f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:01.797517 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a996f5d2-ce12-460e-be0c-175c29427c9f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:01.798108 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a996f5d2-ce12-460e-be0c-175c29427c9f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:01.798750 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a996f5d2-ce12-460e-be0c-175c29427c9f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:01.799635 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a996f5d2-ce12-460e-be0c-175c29427c9f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:01.800190 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a996f5d2-ce12-460e-be0c-175c29427c9f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:01.800604 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a996f5d2-ce12-460e-be0c-175c29427c9f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:01.946199 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a996f5d2-ce12-460e-be0c-175c29427c9f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:01.966771 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a996f5d2-ce12-460e-be0c-175c29427c9f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1260 microversion: 2.1 time: 0.181632 Aug 17 07:36:01.967718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 486/966] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:01 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:02.989362 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f7fd54cf-28a7-498c-99f6-258248f910d1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:02.990699 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f7fd54cf-28a7-498c-99f6-258248f910d1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:02.998421 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f7fd54cf-28a7-498c-99f6-258248f910d1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:02.998898 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f7fd54cf-28a7-498c-99f6-258248f910d1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:02.999360 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f7fd54cf-28a7-498c-99f6-258248f910d1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:03.000248 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f7fd54cf-28a7-498c-99f6-258248f910d1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:03.000768 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f7fd54cf-28a7-498c-99f6-258248f910d1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:03.001192 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f7fd54cf-28a7-498c-99f6-258248f910d1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:03.147616 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f7fd54cf-28a7-498c-99f6-258248f910d1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:03.155532 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f7fd54cf-28a7-498c-99f6-258248f910d1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1260 microversion: 2.1 time: 0.170303 Aug 17 07:36:03.156312 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 481/967] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:02 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:03.861484 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-01dd099b-228c-4051-8ef7-12bc7d1754af tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:03.862022 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-01dd099b-228c-4051-8ef7-12bc7d1754af tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:03.868641 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-01dd099b-228c-4051-8ef7-12bc7d1754af tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:03.869124 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-01dd099b-228c-4051-8ef7-12bc7d1754af tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:03.869565 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-01dd099b-228c-4051-8ef7-12bc7d1754af tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:03.870289 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-01dd099b-228c-4051-8ef7-12bc7d1754af tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:03.870747 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-01dd099b-228c-4051-8ef7-12bc7d1754af tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:03.871173 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-01dd099b-228c-4051-8ef7-12bc7d1754af tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:03.957553 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.objects.instance [None req-01dd099b-228c-4051-8ef7-12bc7d1754af tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lazy-loading 'services' on Instance uuid d9638bd7-f534-4b78-b45a-d614d08be219 {{(pid=120835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:36:04.030855 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-01dd099b-228c-4051-8ef7-12bc7d1754af tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219/os-volume_attachments/c3b3d295-cc71-4309-abb3-db1b4df7e28b" status: 202 len: 0 microversion: 2.1 time: 0.173048 Aug 17 07:36:04.031474 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 487/968] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 17 07:36:03 2022] DELETE /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219/os-volume_attachments/c3b3d295-cc71-4309-abb3-db1b4df7e28b => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:36:04.175674 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-e080115d-82b1-4f5c-be96-66a4a07ae4ca tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:04.176279 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-e080115d-82b1-4f5c-be96-66a4a07ae4ca tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:04.183470 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e080115d-82b1-4f5c-be96-66a4a07ae4ca tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:04.183884 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e080115d-82b1-4f5c-be96-66a4a07ae4ca tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:04.184310 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e080115d-82b1-4f5c-be96-66a4a07ae4ca tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:04.184989 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e080115d-82b1-4f5c-be96-66a4a07ae4ca tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:04.185433 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e080115d-82b1-4f5c-be96-66a4a07ae4ca tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:04.185849 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-e080115d-82b1-4f5c-be96-66a4a07ae4ca tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:04.324326 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-e080115d-82b1-4f5c-be96-66a4a07ae4ca tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:04.331844 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-e080115d-82b1-4f5c-be96-66a4a07ae4ca tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1260 microversion: 2.1 time: 0.160013 Aug 17 07:36:04.332396 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 482/969] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:04 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:05.166693 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-64feb2b2-8598-4440-a20a-e7d16ab34eaa tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:05.167402 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-64feb2b2-8598-4440-a20a-e7d16ab34eaa tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:05.173762 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-64feb2b2-8598-4440-a20a-e7d16ab34eaa tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:05.174278 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-64feb2b2-8598-4440-a20a-e7d16ab34eaa tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:05.174712 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-64feb2b2-8598-4440-a20a-e7d16ab34eaa tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:05.175802 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-64feb2b2-8598-4440-a20a-e7d16ab34eaa tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:05.175953 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-64feb2b2-8598-4440-a20a-e7d16ab34eaa tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:05.176247 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-64feb2b2-8598-4440-a20a-e7d16ab34eaa tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:05.201953 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-64feb2b2-8598-4440-a20a-e7d16ab34eaa tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Going to try to terminate instance {{(pid=120835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:36:05.277192 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-64feb2b2-8598-4440-a20a-e7d16ab34eaa tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219" status: 204 len: 0 microversion: 2.1 time: 0.115335 Aug 17 07:36:05.277786 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 488/970] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:36:05 2022] DELETE /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:36:05.286024 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-25628679-a5f1-4609-ac9b-94a30364bc1e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:05.286633 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-25628679-a5f1-4609-ac9b-94a30364bc1e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:05.293544 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-25628679-a5f1-4609-ac9b-94a30364bc1e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:05.294051 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-25628679-a5f1-4609-ac9b-94a30364bc1e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:05.294489 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-25628679-a5f1-4609-ac9b-94a30364bc1e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:05.295169 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-25628679-a5f1-4609-ac9b-94a30364bc1e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:05.295620 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-25628679-a5f1-4609-ac9b-94a30364bc1e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:05.296051 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-25628679-a5f1-4609-ac9b-94a30364bc1e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:05.354435 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-26c9320c-62d5-46cc-b097-c794ac4fbffc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:05.355359 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-26c9320c-62d5-46cc-b097-c794ac4fbffc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:05.361413 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-26c9320c-62d5-46cc-b097-c794ac4fbffc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:05.361865 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-26c9320c-62d5-46cc-b097-c794ac4fbffc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:05.362338 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-26c9320c-62d5-46cc-b097-c794ac4fbffc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:05.363033 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-26c9320c-62d5-46cc-b097-c794ac4fbffc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:05.363482 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-26c9320c-62d5-46cc-b097-c794ac4fbffc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:05.363904 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-26c9320c-62d5-46cc-b097-c794ac4fbffc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:05.472892 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-25628679-a5f1-4609-ac9b-94a30364bc1e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:05.481172 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-25628679-a5f1-4609-ac9b-94a30364bc1e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219" status: 200 len: 1513 microversion: 2.1 time: 0.199017 Aug 17 07:36:05.481732 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 483/971] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:05 2022] GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:05.519996 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-26c9320c-62d5-46cc-b097-c794ac4fbffc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:05.527625 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-26c9320c-62d5-46cc-b097-c794ac4fbffc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1260 microversion: 2.1 time: 0.179179 Aug 17 07:36:05.528188 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 489/972] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:05 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:36:06.502958 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-036d581c-0841-4a4f-9f28-be119673cc8a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:06.503860 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-036d581c-0841-4a4f-9f28-be119673cc8a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:06.511290 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-036d581c-0841-4a4f-9f28-be119673cc8a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:06.511928 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-036d581c-0841-4a4f-9f28-be119673cc8a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:06.512427 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-036d581c-0841-4a4f-9f28-be119673cc8a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:06.513197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-036d581c-0841-4a4f-9f28-be119673cc8a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:06.513652 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-036d581c-0841-4a4f-9f28-be119673cc8a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:06.514258 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-036d581c-0841-4a4f-9f28-be119673cc8a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:06.548007 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-aa5c5309-086e-464e-9142-59c741efce6f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:06.548621 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-aa5c5309-086e-464e-9142-59c741efce6f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:06.555921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa5c5309-086e-464e-9142-59c741efce6f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:06.556501 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa5c5309-086e-464e-9142-59c741efce6f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:06.557001 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa5c5309-086e-464e-9142-59c741efce6f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:06.557984 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa5c5309-086e-464e-9142-59c741efce6f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:06.558444 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa5c5309-086e-464e-9142-59c741efce6f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:06.558974 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aa5c5309-086e-464e-9142-59c741efce6f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:06.708935 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-036d581c-0841-4a4f-9f28-be119673cc8a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:06.722142 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-036d581c-0841-4a4f-9f28-be119673cc8a tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219" status: 200 len: 1513 microversion: 2.1 time: 0.223070 Aug 17 07:36:06.722746 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 484/973] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:06 2022] GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 => generated 1513 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:06.728163 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-f25fe117-5d7d-45e6-b33c-64cce03ce9f6 req-e38969fc-02d7-47dc-ac65-8713f31b930b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e628869-f998-4c45-a905-3dd276ca94f5", "name": "network-vif-plugged", "status": "completed", "tag": "9baee402-152f-4aa2-a956-c2704e4b760c"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:36:06.737268 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-f25fe117-5d7d-45e6-b33c-64cce03ce9f6 req-e38969fc-02d7-47dc-ac65-8713f31b930b service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:06.737735 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-f25fe117-5d7d-45e6-b33c-64cce03ce9f6 req-e38969fc-02d7-47dc-ac65-8713f31b930b service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:06.738200 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-f25fe117-5d7d-45e6-b33c-64cce03ce9f6 req-e38969fc-02d7-47dc-ac65-8713f31b930b service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:06.747523 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-aa5c5309-086e-464e-9142-59c741efce6f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:06.749627 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-f25fe117-5d7d-45e6-b33c-64cce03ce9f6 req-e38969fc-02d7-47dc-ac65-8713f31b930b service nova] Creating event network-vif-plugged:9baee402-152f-4aa2-a956-c2704e4b760c for instance 4e628869-f998-4c45-a905-3dd276ca94f5 on hv-cinder-85312 Aug 17 07:36:06.751109 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:06.754979 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-f25fe117-5d7d-45e6-b33c-64cce03ce9f6 req-e38969fc-02d7-47dc-ac65-8713f31b930b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030864 Aug 17 07:36:06.755282 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 485/974] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:36:06.756119 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-aa5c5309-086e-464e-9142-59c741efce6f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1260 microversion: 2.1 time: 0.211981 Aug 17 07:36:06.756676 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 490/975] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:06 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:36:07.744189 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-5e4dad1e-1485-445b-9cda-c7515fc95879 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:07.744951 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-5e4dad1e-1485-445b-9cda-c7515fc95879 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:07.751462 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5e4dad1e-1485-445b-9cda-c7515fc95879 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:07.751950 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5e4dad1e-1485-445b-9cda-c7515fc95879 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:07.752385 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5e4dad1e-1485-445b-9cda-c7515fc95879 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:07.753084 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5e4dad1e-1485-445b-9cda-c7515fc95879 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:07.753534 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5e4dad1e-1485-445b-9cda-c7515fc95879 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:07.753984 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-5e4dad1e-1485-445b-9cda-c7515fc95879 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:07.778280 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-0bd25658-8e71-4419-8ad0-36eeddd43a1a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:07.779618 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-0bd25658-8e71-4419-8ad0-36eeddd43a1a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:07.792035 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0bd25658-8e71-4419-8ad0-36eeddd43a1a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:07.792970 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0bd25658-8e71-4419-8ad0-36eeddd43a1a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:07.793635 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0bd25658-8e71-4419-8ad0-36eeddd43a1a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:07.794840 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0bd25658-8e71-4419-8ad0-36eeddd43a1a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:07.795649 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0bd25658-8e71-4419-8ad0-36eeddd43a1a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:07.797324 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0bd25658-8e71-4419-8ad0-36eeddd43a1a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:07.829103 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-5e4dad1e-1485-445b-9cda-c7515fc95879 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:07.838407 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-5e4dad1e-1485-445b-9cda-c7515fc95879 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219" status: 200 len: 1471 microversion: 2.1 time: 0.099127 Aug 17 07:36:07.838977 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 486/976] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:07 2022] GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 => generated 1471 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:07.844323 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-67a1f491-1447-4d4c-a0cd-cdc6f4881538 req-1782a28e-07d4-4828-b127-5c7810a043a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9638bd7-f534-4b78-b45a-d614d08be219", "name": "network-vif-deleted", "tag": "fde4c17b-8069-4fc0-8678-cd428e8230eb"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:36:07.853582 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-67a1f491-1447-4d4c-a0cd-cdc6f4881538 req-1782a28e-07d4-4828-b127-5c7810a043a2 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:07.854075 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-67a1f491-1447-4d4c-a0cd-cdc6f4881538 req-1782a28e-07d4-4828-b127-5c7810a043a2 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:07.854500 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-67a1f491-1447-4d4c-a0cd-cdc6f4881538 req-1782a28e-07d4-4828-b127-5c7810a043a2 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:07.865234 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-67a1f491-1447-4d4c-a0cd-cdc6f4881538 req-1782a28e-07d4-4828-b127-5c7810a043a2 service nova] Creating event network-vif-deleted:fde4c17b-8069-4fc0-8678-cd428e8230eb for instance d9638bd7-f534-4b78-b45a-d614d08be219 on hv-cinder-85312 Aug 17 07:36:07.870284 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-67a1f491-1447-4d4c-a0cd-cdc6f4881538 req-1782a28e-07d4-4828-b127-5c7810a043a2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029237 Aug 17 07:36:07.871032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 487/977] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:36:07.943532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-0bd25658-8e71-4419-8ad0-36eeddd43a1a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:07.951537 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-0bd25658-8e71-4419-8ad0-36eeddd43a1a tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1260 microversion: 2.1 time: 0.178681 Aug 17 07:36:07.952099 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 491/978] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:07 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:36:08.860930 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9e5bb7cf-5ebb-4c9a-bdfa-b2e519f536e7 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:08.861637 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9e5bb7cf-5ebb-4c9a-bdfa-b2e519f536e7 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:08.868992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9e5bb7cf-5ebb-4c9a-bdfa-b2e519f536e7 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:08.869471 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9e5bb7cf-5ebb-4c9a-bdfa-b2e519f536e7 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:08.869905 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9e5bb7cf-5ebb-4c9a-bdfa-b2e519f536e7 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:08.870625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9e5bb7cf-5ebb-4c9a-bdfa-b2e519f536e7 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:08.871076 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9e5bb7cf-5ebb-4c9a-bdfa-b2e519f536e7 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:08.871499 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9e5bb7cf-5ebb-4c9a-bdfa-b2e519f536e7 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:08.901239 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9e5bb7cf-5ebb-4c9a-bdfa-b2e519f536e7 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:08.901711 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9e5bb7cf-5ebb-4c9a-bdfa-b2e519f536e7 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:08.902184 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9e5bb7cf-5ebb-4c9a-bdfa-b2e519f536e7 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:08.902627 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.objects.instance [None req-9e5bb7cf-5ebb-4c9a-bdfa-b2e519f536e7 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lazy-loading 'fault' on Instance uuid d9638bd7-f534-4b78-b45a-d614d08be219 {{(pid=120834) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:36:08.945224 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-9e5bb7cf-5ebb-4c9a-bdfa-b2e519f536e7 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:08.952802 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9e5bb7cf-5ebb-4c9a-bdfa-b2e519f536e7 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219" status: 200 len: 1308 microversion: 2.1 time: 0.097262 Aug 17 07:36:08.953367 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 488/979] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:08 2022] GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:08.972980 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-77890952-f571-4d17-8029-a17bc3d2a9f5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:08.973900 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-77890952-f571-4d17-8029-a17bc3d2a9f5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:08.981719 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-77890952-f571-4d17-8029-a17bc3d2a9f5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:08.982359 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-77890952-f571-4d17-8029-a17bc3d2a9f5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:08.982865 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-77890952-f571-4d17-8029-a17bc3d2a9f5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:08.983640 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-77890952-f571-4d17-8029-a17bc3d2a9f5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:08.984217 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-77890952-f571-4d17-8029-a17bc3d2a9f5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:08.984839 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-77890952-f571-4d17-8029-a17bc3d2a9f5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:09.123748 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-77890952-f571-4d17-8029-a17bc3d2a9f5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:09.131286 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-77890952-f571-4d17-8029-a17bc3d2a9f5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1444 microversion: 2.1 time: 0.162375 Aug 17 07:36:09.131848 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 492/980] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:08 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1444 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:09.151290 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ede37b52-911c-487f-9f38-218fc172b010 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:09.151933 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ede37b52-911c-487f-9f38-218fc172b010 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:09.158146 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ede37b52-911c-487f-9f38-218fc172b010 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:09.158619 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ede37b52-911c-487f-9f38-218fc172b010 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:09.159078 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ede37b52-911c-487f-9f38-218fc172b010 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:09.159827 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ede37b52-911c-487f-9f38-218fc172b010 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:09.160324 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ede37b52-911c-487f-9f38-218fc172b010 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:09.160801 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ede37b52-911c-487f-9f38-218fc172b010 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:09.299822 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ede37b52-911c-487f-9f38-218fc172b010 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:09.307316 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ede37b52-911c-487f-9f38-218fc172b010 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1444 microversion: 2.1 time: 0.160357 Aug 17 07:36:09.307886 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 489/981] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:09 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:09.974413 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-7e7bcd1f-94c1-4e54-9233-3482124bd055 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:09.975061 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-7e7bcd1f-94c1-4e54-9233-3482124bd055 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: d9638bd7-f534-4b78-b45a-d614d08be219] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:09.978081 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:09.983349 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7e7bcd1f-94c1-4e54-9233-3482124bd055 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:09.983912 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7e7bcd1f-94c1-4e54-9233-3482124bd055 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:09.984421 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7e7bcd1f-94c1-4e54-9233-3482124bd055 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:09.985183 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7e7bcd1f-94c1-4e54-9233-3482124bd055 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:09.985733 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7e7bcd1f-94c1-4e54-9233-3482124bd055 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:09.986273 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-7e7bcd1f-94c1-4e54-9233-3482124bd055 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:10.001242 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-7e7bcd1f-94c1-4e54-9233-3482124bd055 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] HTTP exception thrown: Instance d9638bd7-f534-4b78-b45a-d614d08be219 could not be found. Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-7e7bcd1f-94c1-4e54-9233-3482124bd055 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Request method failure captured: Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 HTTP/1.1 Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JoaGzw0CStpKQzgM3Q2aBw7ROq4VRdRFMaztb-5fw4Ss_m89rqPocRWYrWdr83U_-GpAQkMgPrDfO6rSbe1RQz_7t_gGbv4rww5zgmcLZEx1Zkd9Lin-H9TxweQtBJP3bd8XXwlvoppJu_dw-e9m1roRvL-OPvyT19x2TA41QU2fKg Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 25b64dfd6164420ba5ffe3b5c81585f2 Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1736775012 Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:36:10.002921 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:36:10.004524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_25b64dfd6164420ba5ffe3b5c81585f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/25b64dfd6164420ba5ffe3b5c81585f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/25b64dfd6164420ba5ffe3b5c81585f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/25b64dfd6164420ba5ffe3b5c81585f2"}]}] Aug 17 07:36:10.004524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-VolumesSnapshotTestJSON-1736775012 Aug 17 07:36:10.004524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 25b64dfd6164420ba5ffe3b5c81585f2 Aug 17 07:36:10.004524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1736775012 Aug 17 07:36:10.004524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-VolumesSnapshotTestJSON-1736775012-project Aug 17 07:36:10.004524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:36:10.004524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:36:10.004524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: 2001cc902b3644488a7d9c58cbf5eb58 Aug 17 07:36:10.004524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-VolumesSnapshotTestJSON-1736775012-project Aug 17 07:36:10.004524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:36:10.004524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance d9638bd7-f534-4b78-b45a-d614d08be219 could not be found. Aug 17 07:36:10.004524 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': 'd9638bd7-f534-4b78-b45a-d614d08be219'} Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9638bd7-f534-4b78-b45a-d614d08be219 could not be found. Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:36:10.009136 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:36:10.010818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:36:10.010818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:36:10.010818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:36:10.010818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:36:10.010818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:36:10.010818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:36:10.010818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:36:10.010818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9638bd7-f534-4b78-b45a-d614d08be219 could not be found. Aug 17 07:36:10.010818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:10.010818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:36:10.010818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:10.010818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:36:10.010818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:36:10.010818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:36:10.010818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:36:10.010818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:36:10.010818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9638bd7-f534-4b78-b45a-d614d08be219 could not be found. Aug 17 07:36:10.010818 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:10.012526 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-7e7bcd1f-94c1-4e54-9233-3482124bd055 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Returning 404 to user: Instance d9638bd7-f534-4b78-b45a-d614d08be219 could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:36:10.012526 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-7e7bcd1f-94c1-4e54-9233-3482124bd055 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219" status: 404 len: 111 microversion: 2.1 time: 0.033803 Aug 17 07:36:10.012526 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 493/982] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:09 2022] GET /compute/v2.1/servers/d9638bd7-f534-4b78-b45a-d614d08be219 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:36:11.332451 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-98dbef4a-66e4-466d-9642-39731836d878 req-31c2aeed-b726-43dc-8169-e9b54064eebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e628869-f998-4c45-a905-3dd276ca94f5", "tag": "9baee402-152f-4aa2-a956-c2704e4b760c"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:36:11.343261 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-98dbef4a-66e4-466d-9642-39731836d878 req-31c2aeed-b726-43dc-8169-e9b54064eebc service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:11.343814 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-98dbef4a-66e4-466d-9642-39731836d878 req-31c2aeed-b726-43dc-8169-e9b54064eebc service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:11.344299 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-98dbef4a-66e4-466d-9642-39731836d878 req-31c2aeed-b726-43dc-8169-e9b54064eebc service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:11.358446 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-98dbef4a-66e4-466d-9642-39731836d878 req-31c2aeed-b726-43dc-8169-e9b54064eebc service nova] Creating event network-changed:9baee402-152f-4aa2-a956-c2704e4b760c for instance 4e628869-f998-4c45-a905-3dd276ca94f5 on hv-cinder-85312 Aug 17 07:36:11.363624 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-98dbef4a-66e4-466d-9642-39731836d878 req-31c2aeed-b726-43dc-8169-e9b54064eebc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034997 Aug 17 07:36:11.364220 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 490/983] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:36:13.469459 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d0691693-3d35-43a6-af39-be348f99f7c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:13.470016 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d0691693-3d35-43a6-af39-be348f99f7c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:13.473677 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-cf5559ab-d346-4015-bfab-6017dedf411b req-124717ff-2365-4dda-a6fb-4f1a33cd18c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d7f0687-dd68-40b7-9f95-279726d56bc0", "tag": "e9ed906d-2552-4f27-bf24-b8cee4b20a07"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:36:13.476491 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d0691693-3d35-43a6-af39-be348f99f7c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:13.476968 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d0691693-3d35-43a6-af39-be348f99f7c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:13.477399 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d0691693-3d35-43a6-af39-be348f99f7c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:13.478131 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d0691693-3d35-43a6-af39-be348f99f7c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:13.478584 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d0691693-3d35-43a6-af39-be348f99f7c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:13.479007 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d0691693-3d35-43a6-af39-be348f99f7c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:13.485692 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-cf5559ab-d346-4015-bfab-6017dedf411b req-124717ff-2365-4dda-a6fb-4f1a33cd18c6 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:13.486264 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-cf5559ab-d346-4015-bfab-6017dedf411b req-124717ff-2365-4dda-a6fb-4f1a33cd18c6 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:13.486950 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-cf5559ab-d346-4015-bfab-6017dedf411b req-124717ff-2365-4dda-a6fb-4f1a33cd18c6 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:13.499395 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-cf5559ab-d346-4015-bfab-6017dedf411b req-124717ff-2365-4dda-a6fb-4f1a33cd18c6 service nova] Creating event network-changed:e9ed906d-2552-4f27-bf24-b8cee4b20a07 for instance 5d7f0687-dd68-40b7-9f95-279726d56bc0 on hv-cinder-85312 Aug 17 07:36:13.504897 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-cf5559ab-d346-4015-bfab-6017dedf411b req-124717ff-2365-4dda-a6fb-4f1a33cd18c6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036167 Aug 17 07:36:13.505724 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d0691693-3d35-43a6-af39-be348f99f7c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Going to try to terminate instance {{(pid=120835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:36:13.505887 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 491/984] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:36:13.583393 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d0691693-3d35-43a6-af39-be348f99f7c1 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 204 len: 0 microversion: 2.1 time: 0.117643 Aug 17 07:36:13.587253 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 494/985] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:36:13 2022] DELETE /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:36:13.592888 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0af0598c-849c-4ce4-8336-157c8856436a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:13.593582 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0af0598c-849c-4ce4-8336-157c8856436a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:13.599718 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0af0598c-849c-4ce4-8336-157c8856436a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:13.600190 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0af0598c-849c-4ce4-8336-157c8856436a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:13.600626 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0af0598c-849c-4ce4-8336-157c8856436a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:13.601323 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0af0598c-849c-4ce4-8336-157c8856436a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:13.601776 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0af0598c-849c-4ce4-8336-157c8856436a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:13.602263 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0af0598c-849c-4ce4-8336-157c8856436a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:13.606845 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=100 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:13.734019 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0af0598c-849c-4ce4-8336-157c8856436a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:13.741630 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0af0598c-849c-4ce4-8336-157c8856436a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1575 microversion: 2.1 time: 0.152903 Aug 17 07:36:13.758580 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 492/986] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:13 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:14.771489 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-5fbaaf32-953e-46f3-a39a-d0d6b1574bda tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:14.772225 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-5fbaaf32-953e-46f3-a39a-d0d6b1574bda tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:14.779130 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5fbaaf32-953e-46f3-a39a-d0d6b1574bda tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:14.779605 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5fbaaf32-953e-46f3-a39a-d0d6b1574bda tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:14.780038 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5fbaaf32-953e-46f3-a39a-d0d6b1574bda tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:14.780712 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5fbaaf32-953e-46f3-a39a-d0d6b1574bda tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:14.781158 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5fbaaf32-953e-46f3-a39a-d0d6b1574bda tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:14.781623 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5fbaaf32-953e-46f3-a39a-d0d6b1574bda tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:14.919196 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-5fbaaf32-953e-46f3-a39a-d0d6b1574bda tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:14.926679 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-5fbaaf32-953e-46f3-a39a-d0d6b1574bda tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1575 microversion: 2.1 time: 0.159432 Aug 17 07:36:14.927236 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 495/987] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:14 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:15.948446 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1a307614-e5b6-4f32-bbed-d61629371c0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:15.949054 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-1a307614-e5b6-4f32-bbed-d61629371c0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:15.951483 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:15.957227 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1a307614-e5b6-4f32-bbed-d61629371c0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:15.957822 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1a307614-e5b6-4f32-bbed-d61629371c0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:15.958349 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1a307614-e5b6-4f32-bbed-d61629371c0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:15.959057 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1a307614-e5b6-4f32-bbed-d61629371c0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:15.959544 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1a307614-e5b6-4f32-bbed-d61629371c0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:15.959970 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1a307614-e5b6-4f32-bbed-d61629371c0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:16.100895 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-1a307614-e5b6-4f32-bbed-d61629371c0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:16.108831 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-1a307614-e5b6-4f32-bbed-d61629371c0a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1575 microversion: 2.1 time: 0.164149 Aug 17 07:36:16.109423 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 493/988] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:15 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:36:16.545594 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-4176600e-e088-4b7d-a4d5-820a32afc38d req-9fdf9e66-f846-4cba-9190-43e6d0cad3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d7f0687-dd68-40b7-9f95-279726d56bc0", "name": "network-vif-deleted", "tag": "e9ed906d-2552-4f27-bf24-b8cee4b20a07"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:36:16.555917 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-4176600e-e088-4b7d-a4d5-820a32afc38d req-9fdf9e66-f846-4cba-9190-43e6d0cad3b6 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:16.556383 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-4176600e-e088-4b7d-a4d5-820a32afc38d req-9fdf9e66-f846-4cba-9190-43e6d0cad3b6 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:16.556808 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-4176600e-e088-4b7d-a4d5-820a32afc38d req-9fdf9e66-f846-4cba-9190-43e6d0cad3b6 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:16.569599 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-4176600e-e088-4b7d-a4d5-820a32afc38d req-9fdf9e66-f846-4cba-9190-43e6d0cad3b6 service nova] Creating event network-vif-deleted:e9ed906d-2552-4f27-bf24-b8cee4b20a07 for instance 5d7f0687-dd68-40b7-9f95-279726d56bc0 on hv-cinder-85312 Aug 17 07:36:16.575642 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-4176600e-e088-4b7d-a4d5-820a32afc38d req-9fdf9e66-f846-4cba-9190-43e6d0cad3b6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033302 Aug 17 07:36:16.576219 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 496/989] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:36:17.130190 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-3cbf5f97-3749-4922-8d05-ae2d4b66df8a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:17.130734 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-3cbf5f97-3749-4922-8d05-ae2d4b66df8a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:17.138127 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3cbf5f97-3749-4922-8d05-ae2d4b66df8a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:17.138600 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3cbf5f97-3749-4922-8d05-ae2d4b66df8a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:17.139031 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3cbf5f97-3749-4922-8d05-ae2d4b66df8a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:17.139714 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3cbf5f97-3749-4922-8d05-ae2d4b66df8a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:17.140161 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3cbf5f97-3749-4922-8d05-ae2d4b66df8a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:17.140580 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3cbf5f97-3749-4922-8d05-ae2d4b66df8a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:17.201603 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-3cbf5f97-3749-4922-8d05-ae2d4b66df8a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:17.209139 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-3cbf5f97-3749-4922-8d05-ae2d4b66df8a tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1508 microversion: 2.1 time: 0.082958 Aug 17 07:36:17.209704 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 494/990] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:17 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1508 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:18.231815 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-a0682637-b96a-4822-bdc1-7dfa7392cb76 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:18.232523 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-a0682637-b96a-4822-bdc1-7dfa7392cb76 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:18.238677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a0682637-b96a-4822-bdc1-7dfa7392cb76 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:18.239162 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a0682637-b96a-4822-bdc1-7dfa7392cb76 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:18.239609 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a0682637-b96a-4822-bdc1-7dfa7392cb76 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:18.240304 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a0682637-b96a-4822-bdc1-7dfa7392cb76 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:18.240764 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a0682637-b96a-4822-bdc1-7dfa7392cb76 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:18.241196 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-a0682637-b96a-4822-bdc1-7dfa7392cb76 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:18.304820 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-a0682637-b96a-4822-bdc1-7dfa7392cb76 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:18.312362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-a0682637-b96a-4822-bdc1-7dfa7392cb76 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1508 microversion: 2.1 time: 0.084997 Aug 17 07:36:18.312927 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 497/991] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:18 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1508 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:19.334099 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-35982ccf-bfb5-4d44-b296-42cc59359b6b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:19.334710 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-35982ccf-bfb5-4d44-b296-42cc59359b6b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:19.341622 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-35982ccf-bfb5-4d44-b296-42cc59359b6b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:19.342138 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-35982ccf-bfb5-4d44-b296-42cc59359b6b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:19.342581 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-35982ccf-bfb5-4d44-b296-42cc59359b6b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:19.343281 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-35982ccf-bfb5-4d44-b296-42cc59359b6b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:19.344110 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-35982ccf-bfb5-4d44-b296-42cc59359b6b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:19.344244 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-35982ccf-bfb5-4d44-b296-42cc59359b6b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:19.427435 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-35982ccf-bfb5-4d44-b296-42cc59359b6b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:19.435712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-35982ccf-bfb5-4d44-b296-42cc59359b6b tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1389 microversion: 2.1 time: 0.105511 Aug 17 07:36:19.436287 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 495/992] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:19 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1389 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:19.933534 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-5d9a19d0-c013-4b0c-8c88-d2fa0f4b5d81 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-35521930", "imageRef": "37843ca7-b19a-44f1-acf3-e9432324d4b2", "flavorRef": "452", "networks": [{"uuid": "2cd251f7-2803-4e52-b15a-188824c49fb8"}]}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:36:19.990647 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.network.neutron [None req-5d9a19d0-c013-4b0c-8c88-d2fa0f4b5d81 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] validate_networks() for [('2cd251f7-2803-4e52-b15a-188824c49fb8', None, None, None, None, None)] {{(pid=120835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 07:36:20.334912 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-5d9a19d0-c013-4b0c-8c88-d2fa0f4b5d81 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Flavor limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 07:36:20.335371 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-5d9a19d0-c013-4b0c-8c88-d2fa0f4b5d81 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Image limits 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 07:36:20.335847 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-5d9a19d0-c013-4b0c-8c88-d2fa0f4b5d81 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Flavor pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 07:36:20.336264 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-5d9a19d0-c013-4b0c-8c88-d2fa0f4b5d81 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Image pref 0:0:0 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 07:36:20.336680 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.virt.hardware [None req-5d9a19d0-c013-4b0c-8c88-d2fa0f4b5d81 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 07:36:20.345333 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5d9a19d0-c013-4b0c-8c88-d2fa0f4b5d81 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:20.345820 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5d9a19d0-c013-4b0c-8c88-d2fa0f4b5d81 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:20.346307 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5d9a19d0-c013-4b0c-8c88-d2fa0f4b5d81 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:20.347041 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5d9a19d0-c013-4b0c-8c88-d2fa0f4b5d81 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:20.347500 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5d9a19d0-c013-4b0c-8c88-d2fa0f4b5d81 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:20.347928 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-5d9a19d0-c013-4b0c-8c88-d2fa0f4b5d81 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:20.364384 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-5d9a19d0-c013-4b0c-8c88-d2fa0f4b5d81 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Getting quotas for project 25b64dfd6164420ba5ffe3b5c81585f2. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 07:36:20.369074 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.quota [None req-5d9a19d0-c013-4b0c-8c88-d2fa0f4b5d81 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Getting quotas for user 2001cc902b3644488a7d9c58cbf5eb58 and project 25b64dfd6164420ba5ffe3b5c81585f2. Resources: {'ram', 'cores', 'instances'} {{(pid=120835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 07:36:20.380053 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-5d9a19d0-c013-4b0c-8c88-d2fa0f4b5d81 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Going to run 1 instances... {{(pid=120835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 07:36:20.382934 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-5d9a19d0-c013-4b0c-8c88-d2fa0f4b5d81 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: a27a8693-50d4-46af-ab02-0d7eb95be4e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37843ca7-b19a-44f1-acf3-e9432324d4b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 07:36:20.427785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-5d9a19d0-c013-4b0c-8c88-d2fa0f4b5d81 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498016 Aug 17 07:36:20.428800 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 498/993] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 17 07:36:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 07:36:20.439738 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-832f0886-8f0a-44ee-9298-e916acbd59bc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:20.440353 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-832f0886-8f0a-44ee-9298-e916acbd59bc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: a27a8693-50d4-46af-ab02-0d7eb95be4e6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:20.458844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-0b7863a6-deef-471b-95a0-5385cb26a387 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:20.459481 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-0b7863a6-deef-471b-95a0-5385cb26a387 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:20.467363 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0b7863a6-deef-471b-95a0-5385cb26a387 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:20.467851 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0b7863a6-deef-471b-95a0-5385cb26a387 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:20.470200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0b7863a6-deef-471b-95a0-5385cb26a387 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:20.471159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0b7863a6-deef-471b-95a0-5385cb26a387 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:20.471740 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0b7863a6-deef-471b-95a0-5385cb26a387 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:20.472532 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0b7863a6-deef-471b-95a0-5385cb26a387 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:20.506888 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0b7863a6-deef-471b-95a0-5385cb26a387 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:20.508028 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0b7863a6-deef-471b-95a0-5385cb26a387 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:20.508543 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-0b7863a6-deef-471b-95a0-5385cb26a387 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:20.509066 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.objects.instance [None req-0b7863a6-deef-471b-95a0-5385cb26a387 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lazy-loading 'fault' on Instance uuid 5d7f0687-dd68-40b7-9f95-279726d56bc0 {{(pid=120835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:36:20.521649 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-832f0886-8f0a-44ee-9298-e916acbd59bc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:20.530230 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-832f0886-8f0a-44ee-9298-e916acbd59bc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6" status: 200 len: 1217 microversion: 2.1 time: 0.094398 Aug 17 07:36:20.530890 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 496/994] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:20 2022] GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:36:20.568122 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-0b7863a6-deef-471b-95a0-5385cb26a387 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:20.575789 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-0b7863a6-deef-471b-95a0-5385cb26a387 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 200 len: 1183 microversion: 2.1 time: 0.121140 Aug 17 07:36:20.576385 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 499/995] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:20 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 1183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:21.551138 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f3454821-2398-4192-af3f-5c0f393b767e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:21.551748 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f3454821-2398-4192-af3f-5c0f393b767e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: a27a8693-50d4-46af-ab02-0d7eb95be4e6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:21.559205 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f3454821-2398-4192-af3f-5c0f393b767e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:21.559681 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f3454821-2398-4192-af3f-5c0f393b767e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:21.560107 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f3454821-2398-4192-af3f-5c0f393b767e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:21.560792 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f3454821-2398-4192-af3f-5c0f393b767e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:21.561236 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f3454821-2398-4192-af3f-5c0f393b767e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:21.561661 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f3454821-2398-4192-af3f-5c0f393b767e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:21.596159 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d09f2e6c-8875-441b-a3a9-dc406ded3d36 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:21.596771 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-d09f2e6c-8875-441b-a3a9-dc406ded3d36 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 5d7f0687-dd68-40b7-9f95-279726d56bc0] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:21.602892 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d09f2e6c-8875-441b-a3a9-dc406ded3d36 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:21.603558 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d09f2e6c-8875-441b-a3a9-dc406ded3d36 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:21.604175 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d09f2e6c-8875-441b-a3a9-dc406ded3d36 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:21.605176 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d09f2e6c-8875-441b-a3a9-dc406ded3d36 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:21.605628 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d09f2e6c-8875-441b-a3a9-dc406ded3d36 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:21.606081 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-d09f2e6c-8875-441b-a3a9-dc406ded3d36 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:21.620033 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-d09f2e6c-8875-441b-a3a9-dc406ded3d36 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] HTTP exception thrown: Instance 5d7f0687-dd68-40b7-9f95-279726d56bc0 could not be found. Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d09f2e6c-8875-441b-a3a9-dc406ded3d36 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Request method failure captured: Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 HTTP/1.1 Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JiGZ4T_dzKDjkBCfxbYu3SMuCbXeL9GtrJz4d6Vgz1o2CVvzQTZQ3Z03-yrHmJoojTNWPa7Fyn6tiiPKyLQVpPI6Rcs17J01gqFySOeGI2AajATYblkh1Mm2kzJrmI7RZ-O5R8PMtKAZdvXPwfXv80M8Oer1Cr8HncocvyrtFJFi3Y Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: afb93daca17c466da3a698536c6b323f Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-TestVolumeBootPattern-104542181 Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:36:21.621830 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:36:21.623350 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_afb93daca17c466da3a698536c6b323f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/afb93daca17c466da3a698536c6b323f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afb93daca17c466da3a698536c6b323f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afb93daca17c466da3a698536c6b323f"}]}] Aug 17 07:36:21.623350 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-TestVolumeBootPattern-104542181 Aug 17 07:36:21.623350 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: afb93daca17c466da3a698536c6b323f Aug 17 07:36:21.623350 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-TestVolumeBootPattern-104542181 Aug 17 07:36:21.623350 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-TestVolumeBootPattern-104542181-project Aug 17 07:36:21.623350 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:36:21.623350 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:36:21.623350 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: b2e79830079c4aa9b95c4622bac45c74 Aug 17 07:36:21.623350 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-TestVolumeBootPattern-104542181-project Aug 17 07:36:21.623350 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:36:21.623350 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance 5d7f0687-dd68-40b7-9f95-279726d56bc0 could not be found. Aug 17 07:36:21.623350 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': '5d7f0687-dd68-40b7-9f95-279726d56bc0'} Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d7f0687-dd68-40b7-9f95-279726d56bc0 could not be found. Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:36:21.624208 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:36:21.625567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:36:21.625567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:36:21.625567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:36:21.625567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:36:21.625567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:36:21.625567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:36:21.625567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:36:21.625567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d7f0687-dd68-40b7-9f95-279726d56bc0 could not be found. Aug 17 07:36:21.625567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:21.625567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:36:21.625567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:21.625567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:36:21.625567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:36:21.625567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:36:21.625567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:36:21.625567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:36:21.625567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d7f0687-dd68-40b7-9f95-279726d56bc0 could not be found. Aug 17 07:36:21.625567 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:21.626860 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-d09f2e6c-8875-441b-a3a9-dc406ded3d36 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Returning 404 to user: Instance 5d7f0687-dd68-40b7-9f95-279726d56bc0 could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:36:21.626860 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-d09f2e6c-8875-441b-a3a9-dc406ded3d36 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0" status: 404 len: 111 microversion: 2.1 time: 0.030856 Aug 17 07:36:21.626860 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 500/996] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:21 2022] GET /compute/v2.1/servers/5d7f0687-dd68-40b7-9f95-279726d56bc0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:36:21.643158 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f3454821-2398-4192-af3f-5c0f393b767e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:21.652015 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f3454821-2398-4192-af3f-5c0f393b767e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6" status: 200 len: 1275 microversion: 2.1 time: 0.104672 Aug 17 07:36:21.652776 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 497/997] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:21 2022] GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6 => generated 1275 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:22.672800 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-35d609ea-2a9a-4ca2-b9b0-ddb7f427b24e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:22.673506 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-35d609ea-2a9a-4ca2-b9b0-ddb7f427b24e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: a27a8693-50d4-46af-ab02-0d7eb95be4e6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:22.681383 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-35d609ea-2a9a-4ca2-b9b0-ddb7f427b24e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:22.682104 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-35d609ea-2a9a-4ca2-b9b0-ddb7f427b24e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:22.682668 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-35d609ea-2a9a-4ca2-b9b0-ddb7f427b24e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:22.683513 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-35d609ea-2a9a-4ca2-b9b0-ddb7f427b24e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:22.684183 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-35d609ea-2a9a-4ca2-b9b0-ddb7f427b24e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:22.684720 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-35d609ea-2a9a-4ca2-b9b0-ddb7f427b24e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:22.729716 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-0a9afd6f-1e99-480d-96d6-fc57807ff8a1 req-d78f02cb-8e30-4d9d-8019-a4cbfdeafb21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a27a8693-50d4-46af-ab02-0d7eb95be4e6", "tag": "e97cc00a-e3b6-4eaa-be0a-7f16c6e93086"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:36:22.742775 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-0a9afd6f-1e99-480d-96d6-fc57807ff8a1 req-d78f02cb-8e30-4d9d-8019-a4cbfdeafb21 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:22.755209 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-0a9afd6f-1e99-480d-96d6-fc57807ff8a1 req-d78f02cb-8e30-4d9d-8019-a4cbfdeafb21 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:22.755209 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-0a9afd6f-1e99-480d-96d6-fc57807ff8a1 req-d78f02cb-8e30-4d9d-8019-a4cbfdeafb21 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:22.775186 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-0a9afd6f-1e99-480d-96d6-fc57807ff8a1 req-d78f02cb-8e30-4d9d-8019-a4cbfdeafb21 service nova] Creating event network-changed:e97cc00a-e3b6-4eaa-be0a-7f16c6e93086 for instance a27a8693-50d4-46af-ab02-0d7eb95be4e6 on hv-cinder-85312 Aug 17 07:36:22.781268 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-0a9afd6f-1e99-480d-96d6-fc57807ff8a1 req-d78f02cb-8e30-4d9d-8019-a4cbfdeafb21 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065624 Aug 17 07:36:22.783158 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 498/998] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:36:22.859319 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-35d609ea-2a9a-4ca2-b9b0-ddb7f427b24e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:22.865820 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-35d609ea-2a9a-4ca2-b9b0-ddb7f427b24e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6" status: 200 len: 1317 microversion: 2.1 time: 0.196877 Aug 17 07:36:22.866450 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 501/999] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:22 2022] GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:23.887001 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0e0304ed-1477-45f3-b33e-ab436946a937 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:23.887746 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0e0304ed-1477-45f3-b33e-ab436946a937 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: a27a8693-50d4-46af-ab02-0d7eb95be4e6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:23.894115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0e0304ed-1477-45f3-b33e-ab436946a937 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:23.894768 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0e0304ed-1477-45f3-b33e-ab436946a937 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:23.895200 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0e0304ed-1477-45f3-b33e-ab436946a937 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:23.895928 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0e0304ed-1477-45f3-b33e-ab436946a937 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:23.896409 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0e0304ed-1477-45f3-b33e-ab436946a937 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:23.896810 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0e0304ed-1477-45f3-b33e-ab436946a937 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:24.034859 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0e0304ed-1477-45f3-b33e-ab436946a937 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:24.042487 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0e0304ed-1477-45f3-b33e-ab436946a937 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6" status: 200 len: 1317 microversion: 2.1 time: 0.160603 Aug 17 07:36:24.043135 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 499/1000] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:23 2022] GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:25.072300 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e38ee9b5-4f02-4a2a-9ab7-881b725c3319 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:25.073552 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e38ee9b5-4f02-4a2a-9ab7-881b725c3319 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: a27a8693-50d4-46af-ab02-0d7eb95be4e6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:25.088688 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-d8936c33-2401-4dfb-b5f5-6e064e3920b2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:25.089816 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-d8936c33-2401-4dfb-b5f5-6e064e3920b2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:25.096373 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8936c33-2401-4dfb-b5f5-6e064e3920b2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:25.096848 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8936c33-2401-4dfb-b5f5-6e064e3920b2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:25.097277 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8936c33-2401-4dfb-b5f5-6e064e3920b2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:25.104883 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e38ee9b5-4f02-4a2a-9ab7-881b725c3319 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:25.105368 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e38ee9b5-4f02-4a2a-9ab7-881b725c3319 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:25.105799 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e38ee9b5-4f02-4a2a-9ab7-881b725c3319 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:25.106820 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e38ee9b5-4f02-4a2a-9ab7-881b725c3319 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:25.107832 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e38ee9b5-4f02-4a2a-9ab7-881b725c3319 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:25.108475 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e38ee9b5-4f02-4a2a-9ab7-881b725c3319 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:25.111987 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8936c33-2401-4dfb-b5f5-6e064e3920b2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:25.112937 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8936c33-2401-4dfb-b5f5-6e064e3920b2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:25.113404 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d8936c33-2401-4dfb-b5f5-6e064e3920b2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:25.151180 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-d8936c33-2401-4dfb-b5f5-6e064e3920b2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Going to try to terminate instance {{(pid=120834) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:36:25.233147 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-d8936c33-2401-4dfb-b5f5-6e064e3920b2 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 204 len: 0 microversion: 2.1 time: 0.148788 Aug 17 07:36:25.234409 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 500/1001] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:36:25 2022] DELETE /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 07:36:25.240665 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-5974099b-f7a9-4a54-9ee9-f4319d2ac23e req-e4568796-2c04-4854-9ba3-868a50b22369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8429d063-003c-4918-85d8-7746d852a8be", "tag": "4929a810-8ffb-4736-afb2-d5142a3cb211"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:36:25.251686 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-5974099b-f7a9-4a54-9ee9-f4319d2ac23e req-e4568796-2c04-4854-9ba3-868a50b22369 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:25.252165 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-5974099b-f7a9-4a54-9ee9-f4319d2ac23e req-e4568796-2c04-4854-9ba3-868a50b22369 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:25.252588 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-5974099b-f7a9-4a54-9ee9-f4319d2ac23e req-e4568796-2c04-4854-9ba3-868a50b22369 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:25.265458 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-5974099b-f7a9-4a54-9ee9-f4319d2ac23e req-e4568796-2c04-4854-9ba3-868a50b22369 service nova] Creating event network-changed:4929a810-8ffb-4736-afb2-d5142a3cb211 for instance 8429d063-003c-4918-85d8-7746d852a8be on hv-cinder-85312 Aug 17 07:36:25.270710 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-5974099b-f7a9-4a54-9ee9-f4319d2ac23e req-e4568796-2c04-4854-9ba3-868a50b22369 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034523 Aug 17 07:36:25.271307 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 501/1002] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:36:25.276355 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-e38ee9b5-4f02-4a2a-9ab7-881b725c3319 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:25.280279 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0abd94f1-f459-432e-9092-f96dd735fc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:25.280581 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0abd94f1-f459-432e-9092-f96dd735fc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:25.284235 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e38ee9b5-4f02-4a2a-9ab7-881b725c3319 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6" status: 200 len: 1317 microversion: 2.1 time: 0.224107 Aug 17 07:36:25.286707 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0abd94f1-f459-432e-9092-f96dd735fc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:25.287017 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 502/1003] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:25 2022] GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:25.287555 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0abd94f1-f459-432e-9092-f96dd735fc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:25.287989 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0abd94f1-f459-432e-9092-f96dd735fc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:25.288745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0abd94f1-f459-432e-9092-f96dd735fc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:25.289192 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0abd94f1-f459-432e-9092-f96dd735fc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:25.289612 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0abd94f1-f459-432e-9092-f96dd735fc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:25.435093 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0abd94f1-f459-432e-9092-f96dd735fc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:25.444250 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0abd94f1-f459-432e-9092-f96dd735fc72 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1575 microversion: 2.1 time: 0.168311 Aug 17 07:36:25.444250 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 502/1004] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:25 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:26.304257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-1d403527-ccad-4ee7-aeb5-7a6d4522936d tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:26.304827 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-1d403527-ccad-4ee7-aeb5-7a6d4522936d tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: a27a8693-50d4-46af-ab02-0d7eb95be4e6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:26.311383 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1d403527-ccad-4ee7-aeb5-7a6d4522936d tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:26.311813 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1d403527-ccad-4ee7-aeb5-7a6d4522936d tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:26.312242 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1d403527-ccad-4ee7-aeb5-7a6d4522936d tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:26.312923 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1d403527-ccad-4ee7-aeb5-7a6d4522936d tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:26.313370 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1d403527-ccad-4ee7-aeb5-7a6d4522936d tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:26.313788 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1d403527-ccad-4ee7-aeb5-7a6d4522936d tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:26.443210 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-1d403527-ccad-4ee7-aeb5-7a6d4522936d tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:26.450508 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-1d403527-ccad-4ee7-aeb5-7a6d4522936d tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6" status: 200 len: 1317 microversion: 2.1 time: 0.150413 Aug 17 07:36:26.451060 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 503/1005] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:26 2022] GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:26.466249 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ba850efb-94ce-44e3-ae82-3221b1b2ebc6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:26.466865 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ba850efb-94ce-44e3-ae82-3221b1b2ebc6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:26.474182 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ba850efb-94ce-44e3-ae82-3221b1b2ebc6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:26.474662 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ba850efb-94ce-44e3-ae82-3221b1b2ebc6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:26.475096 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ba850efb-94ce-44e3-ae82-3221b1b2ebc6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:26.476467 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ba850efb-94ce-44e3-ae82-3221b1b2ebc6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:26.476922 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ba850efb-94ce-44e3-ae82-3221b1b2ebc6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:26.477349 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ba850efb-94ce-44e3-ae82-3221b1b2ebc6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:26.606764 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ba850efb-94ce-44e3-ae82-3221b1b2ebc6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:26.614745 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ba850efb-94ce-44e3-ae82-3221b1b2ebc6 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1575 microversion: 2.1 time: 0.152439 Aug 17 07:36:26.615322 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 503/1006] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:26 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:27.471661 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ce6c8dec-3b58-4674-aefd-203bd862edc2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:27.472974 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-ce6c8dec-3b58-4674-aefd-203bd862edc2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: a27a8693-50d4-46af-ab02-0d7eb95be4e6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:27.483963 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ce6c8dec-3b58-4674-aefd-203bd862edc2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:27.485140 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ce6c8dec-3b58-4674-aefd-203bd862edc2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:27.485827 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ce6c8dec-3b58-4674-aefd-203bd862edc2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:27.486924 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ce6c8dec-3b58-4674-aefd-203bd862edc2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:27.487673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ce6c8dec-3b58-4674-aefd-203bd862edc2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:27.488284 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ce6c8dec-3b58-4674-aefd-203bd862edc2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:27.569125 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-b8a9296d-5384-4cc7-8435-f3d582747508 req-8ce6b4d0-e939-47c6-946b-dfe5d034f5fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a27a8693-50d4-46af-ab02-0d7eb95be4e6", "name": "network-vif-plugged", "status": "completed", "tag": "e97cc00a-e3b6-4eaa-be0a-7f16c6e93086"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:36:27.587138 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-b8a9296d-5384-4cc7-8435-f3d582747508 req-8ce6b4d0-e939-47c6-946b-dfe5d034f5fe service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:27.589279 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-b8a9296d-5384-4cc7-8435-f3d582747508 req-8ce6b4d0-e939-47c6-946b-dfe5d034f5fe service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:27.589936 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-b8a9296d-5384-4cc7-8435-f3d582747508 req-8ce6b4d0-e939-47c6-946b-dfe5d034f5fe service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:27.603742 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.compute.server_external_events [req-b8a9296d-5384-4cc7-8435-f3d582747508 req-8ce6b4d0-e939-47c6-946b-dfe5d034f5fe service nova] Creating event network-vif-plugged:e97cc00a-e3b6-4eaa-be0a-7f16c6e93086 for instance a27a8693-50d4-46af-ab02-0d7eb95be4e6 on hv-cinder-85312 Aug 17 07:36:27.611520 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-b8a9296d-5384-4cc7-8435-f3d582747508 req-8ce6b4d0-e939-47c6-946b-dfe5d034f5fe service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048174 Aug 17 07:36:27.612851 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 504/1007] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:36:27.651929 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-ee484306-2ce7-4e48-ab4a-8c46dec4b6fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:27.654787 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-ee484306-2ce7-4e48-ab4a-8c46dec4b6fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:27.661925 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee484306-2ce7-4e48-ab4a-8c46dec4b6fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:27.663041 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee484306-2ce7-4e48-ab4a-8c46dec4b6fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:27.664380 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee484306-2ce7-4e48-ab4a-8c46dec4b6fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:27.665284 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee484306-2ce7-4e48-ab4a-8c46dec4b6fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:27.665925 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee484306-2ce7-4e48-ab4a-8c46dec4b6fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:27.666577 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-ee484306-2ce7-4e48-ab4a-8c46dec4b6fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:27.699030 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ce6c8dec-3b58-4674-aefd-203bd862edc2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:27.706910 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-ce6c8dec-3b58-4674-aefd-203bd862edc2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6" status: 200 len: 1317 microversion: 2.1 time: 0.239230 Aug 17 07:36:27.711021 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 504/1008] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:27 2022] GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:27.838995 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-ee484306-2ce7-4e48-ab4a-8c46dec4b6fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:27.847699 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-ee484306-2ce7-4e48-ab4a-8c46dec4b6fd tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1456 microversion: 2.1 time: 0.215019 Aug 17 07:36:27.858227 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 505/1009] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:27 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1456 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:36:27.932838 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-7779f88e-b821-496b-9687-16671704597a req-5fa752a5-fbdb-472b-817c-79274d4006a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8429d063-003c-4918-85d8-7746d852a8be", "name": "network-vif-deleted", "tag": "4929a810-8ffb-4736-afb2-d5142a3cb211"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:36:27.942958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-7779f88e-b821-496b-9687-16671704597a req-5fa752a5-fbdb-472b-817c-79274d4006a4 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:27.943742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-7779f88e-b821-496b-9687-16671704597a req-5fa752a5-fbdb-472b-817c-79274d4006a4 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:27.944171 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-7779f88e-b821-496b-9687-16671704597a req-5fa752a5-fbdb-472b-817c-79274d4006a4 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:27.956891 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-7779f88e-b821-496b-9687-16671704597a req-5fa752a5-fbdb-472b-817c-79274d4006a4 service nova] Creating event network-vif-deleted:4929a810-8ffb-4736-afb2-d5142a3cb211 for instance 8429d063-003c-4918-85d8-7746d852a8be on hv-cinder-85312 Aug 17 07:36:27.963006 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-7779f88e-b821-496b-9687-16671704597a req-5fa752a5-fbdb-472b-817c-79274d4006a4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034057 Aug 17 07:36:27.963493 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 505/1010] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:36:28.727868 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-1f9febdc-af12-48a9-91ba-28e45bd53e0e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:28.728477 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-1f9febdc-af12-48a9-91ba-28e45bd53e0e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: a27a8693-50d4-46af-ab02-0d7eb95be4e6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:28.734778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1f9febdc-af12-48a9-91ba-28e45bd53e0e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:28.735257 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1f9febdc-af12-48a9-91ba-28e45bd53e0e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:28.735690 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1f9febdc-af12-48a9-91ba-28e45bd53e0e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:28.736376 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1f9febdc-af12-48a9-91ba-28e45bd53e0e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:28.736825 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1f9febdc-af12-48a9-91ba-28e45bd53e0e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:28.737253 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-1f9febdc-af12-48a9-91ba-28e45bd53e0e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:28.868150 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-1f9febdc-af12-48a9-91ba-28e45bd53e0e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:28.871609 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-060eeff9-a6a2-4a5c-865d-08fb47d96a37 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:28.872313 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-060eeff9-a6a2-4a5c-865d-08fb47d96a37 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:28.876955 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-1f9febdc-af12-48a9-91ba-28e45bd53e0e tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6" status: 200 len: 1317 microversion: 2.1 time: 0.152932 Aug 17 07:36:28.886100 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 506/1011] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:28 2022] GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:28.886264 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-060eeff9-a6a2-4a5c-865d-08fb47d96a37 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:28.886627 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-060eeff9-a6a2-4a5c-865d-08fb47d96a37 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:28.887064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-060eeff9-a6a2-4a5c-865d-08fb47d96a37 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:28.887764 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-060eeff9-a6a2-4a5c-865d-08fb47d96a37 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:28.888217 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-060eeff9-a6a2-4a5c-865d-08fb47d96a37 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:28.888638 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-060eeff9-a6a2-4a5c-865d-08fb47d96a37 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:28.919915 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-060eeff9-a6a2-4a5c-865d-08fb47d96a37 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:28.920386 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-060eeff9-a6a2-4a5c-865d-08fb47d96a37 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:28.920820 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-060eeff9-a6a2-4a5c-865d-08fb47d96a37 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:28.921256 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.objects.instance [None req-060eeff9-a6a2-4a5c-865d-08fb47d96a37 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lazy-loading 'fault' on Instance uuid 8429d063-003c-4918-85d8-7746d852a8be {{(pid=120835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:36:28.962431 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-060eeff9-a6a2-4a5c-865d-08fb47d96a37 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e79830079c4aa9b95c4622bac45c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb93daca17c466da3a698536c6b323f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:28.971905 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-060eeff9-a6a2-4a5c-865d-08fb47d96a37 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 200 len: 1229 microversion: 2.1 time: 0.105811 Aug 17 07:36:28.972828 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 506/1012] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:28 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 1229 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:29.896819 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-0598a81c-4f96-4bf4-a9d3-b899cb953f66 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:29.898039 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-0598a81c-4f96-4bf4-a9d3-b899cb953f66 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: a27a8693-50d4-46af-ab02-0d7eb95be4e6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:29.904433 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0598a81c-4f96-4bf4-a9d3-b899cb953f66 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:29.904908 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0598a81c-4f96-4bf4-a9d3-b899cb953f66 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:29.905335 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0598a81c-4f96-4bf4-a9d3-b899cb953f66 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:29.906039 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0598a81c-4f96-4bf4-a9d3-b899cb953f66 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:29.906489 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0598a81c-4f96-4bf4-a9d3-b899cb953f66 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:29.906992 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-0598a81c-4f96-4bf4-a9d3-b899cb953f66 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:29.993301 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e760fa38-da43-47f9-8799-dceff45e2db0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:29.993914 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e760fa38-da43-47f9-8799-dceff45e2db0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: 8429d063-003c-4918-85d8-7746d852a8be] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:30.000241 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e760fa38-da43-47f9-8799-dceff45e2db0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:30.000723 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e760fa38-da43-47f9-8799-dceff45e2db0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:30.001153 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e760fa38-da43-47f9-8799-dceff45e2db0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:30.001832 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e760fa38-da43-47f9-8799-dceff45e2db0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:30.002315 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e760fa38-da43-47f9-8799-dceff45e2db0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:30.002737 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e760fa38-da43-47f9-8799-dceff45e2db0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:30.016682 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-e760fa38-da43-47f9-8799-dceff45e2db0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] HTTP exception thrown: Instance 8429d063-003c-4918-85d8-7746d852a8be could not be found. Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e760fa38-da43-47f9-8799-dceff45e2db0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Request method failure captured: Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be HTTP/1.1 Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JiGZ4T_dzKDjkBCfxbYu3SMuCbXeL9GtrJz4d6Vgz1o2CVvzQTZQ3Z03-yrHmJoojTNWPa7Fyn6tiiPKyLQVpPI6Rcs17J01gqFySOeGI2AajATYblkh1Mm2kzJrmI7RZ-O5R8PMtKAZdvXPwfXv80M8Oer1Cr8HncocvyrtFJFi3Y Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: afb93daca17c466da3a698536c6b323f Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-TestVolumeBootPattern-104542181 Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:36:30.018356 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:36:30.019777 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_afb93daca17c466da3a698536c6b323f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/afb93daca17c466da3a698536c6b323f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afb93daca17c466da3a698536c6b323f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afb93daca17c466da3a698536c6b323f"}]}] Aug 17 07:36:30.019777 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-TestVolumeBootPattern-104542181 Aug 17 07:36:30.019777 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: afb93daca17c466da3a698536c6b323f Aug 17 07:36:30.019777 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-TestVolumeBootPattern-104542181 Aug 17 07:36:30.019777 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-TestVolumeBootPattern-104542181-project Aug 17 07:36:30.019777 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:36:30.019777 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:36:30.019777 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: b2e79830079c4aa9b95c4622bac45c74 Aug 17 07:36:30.019777 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-TestVolumeBootPattern-104542181-project Aug 17 07:36:30.019777 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:36:30.019777 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance 8429d063-003c-4918-85d8-7746d852a8be could not be found. Aug 17 07:36:30.019777 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': '8429d063-003c-4918-85d8-7746d852a8be'} Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8429d063-003c-4918-85d8-7746d852a8be could not be found. Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:36:30.020677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:36:30.022092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:36:30.022092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:36:30.022092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:36:30.022092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:36:30.022092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:36:30.022092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:36:30.022092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:36:30.022092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8429d063-003c-4918-85d8-7746d852a8be could not be found. Aug 17 07:36:30.022092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:30.022092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:36:30.022092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:30.022092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:36:30.022092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:36:30.022092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:36:30.022092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:36:30.022092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:36:30.022092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8429d063-003c-4918-85d8-7746d852a8be could not be found. Aug 17 07:36:30.022092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:30.023273 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e760fa38-da43-47f9-8799-dceff45e2db0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Returning 404 to user: Instance 8429d063-003c-4918-85d8-7746d852a8be could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:36:30.023273 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e760fa38-da43-47f9-8799-dceff45e2db0 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be" status: 404 len: 111 microversion: 2.1 time: 0.031041 Aug 17 07:36:30.023273 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 507/1013] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:29 2022] GET /compute/v2.1/servers/8429d063-003c-4918-85d8-7746d852a8be => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 07:36:30.035363 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-0598a81c-4f96-4bf4-a9d3-b899cb953f66 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:30.042825 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-0598a81c-4f96-4bf4-a9d3-b899cb953f66 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6" status: 200 len: 1506 microversion: 2.1 time: 0.149840 Aug 17 07:36:30.043391 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 507/1014] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:29 2022] GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:30.063131 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-8b013e96-c7e1-4ca3-95bd-c6bf8769c2be tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cd6f34e-28aa-418d-850a-82f0b629f16f", "device": "/dev/sdb"}} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:36:30.065516 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-8b013e96-c7e1-4ca3-95bd-c6bf8769c2be tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: a27a8693-50d4-46af-ab02-0d7eb95be4e6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:30.072031 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8b013e96-c7e1-4ca3-95bd-c6bf8769c2be tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:30.072511 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8b013e96-c7e1-4ca3-95bd-c6bf8769c2be tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:30.072945 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8b013e96-c7e1-4ca3-95bd-c6bf8769c2be tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:30.073650 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8b013e96-c7e1-4ca3-95bd-c6bf8769c2be tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:30.074126 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8b013e96-c7e1-4ca3-95bd-c6bf8769c2be tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:30.074551 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-8b013e96-c7e1-4ca3-95bd-c6bf8769c2be tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:30.197778 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:30.314464 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-8b013e96-c7e1-4ca3-95bd-c6bf8769c2be tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "POST /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254911 Aug 17 07:36:30.315378 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 508/1015] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 17 07:36:30 2022] POST /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:36:30.486769 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7d360915-a2d4-4a3f-ba84-0e18be17d314 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:30.487290 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-7d360915-a2d4-4a3f-ba84-0e18be17d314 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:30.493456 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7d360915-a2d4-4a3f-ba84-0e18be17d314 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:30.493945 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7d360915-a2d4-4a3f-ba84-0e18be17d314 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:30.494401 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7d360915-a2d4-4a3f-ba84-0e18be17d314 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:30.495090 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7d360915-a2d4-4a3f-ba84-0e18be17d314 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:30.495544 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7d360915-a2d4-4a3f-ba84-0e18be17d314 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:30.495980 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-7d360915-a2d4-4a3f-ba84-0e18be17d314 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:30.509359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.wsgi [None req-7d360915-a2d4-4a3f-ba84-0e18be17d314 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] HTTP exception thrown: Instance da23597a-1e52-4e8a-bd7b-28bd175471ae could not be found. Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7d360915-a2d4-4a3f-ba84-0e18be17d314 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Request method failure captured: Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: request: DELETE /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae HTTP/1.1 Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept: application/json Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Accept-Encoding: identity Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Connection: close Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Length: 0 Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Content-Type: application/json Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Host: 10.222.0.45 Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Openstack-System-Scope: None Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: User-Agent: python-urllib3/1.26.11 Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Auth-Token: gAAAAABi_JiGZ4T_dzKDjkBCfxbYu3SMuCbXeL9GtrJz4d6Vgz1o2CVvzQTZQ3Z03-yrHmJoojTNWPa7Fyn6tiiPKyLQVpPI6Rcs17J01gqFySOeGI2AajATYblkh1Mm2kzJrmI7RZ-O5R8PMtKAZdvXPwfXv80M8Oer1Cr8HncocvyrtFJFi3Y Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Id: None Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Domain-Name: None Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Identity-Status: Confirmed Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Is-Admin-Project: True Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Id: default Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Domain-Name: Default Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Id: afb93daca17c466da3a698536c6b323f Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Project-Name: tempest-TestVolumeBootPattern-104542181 Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Role: member,reader Aug 17 07:36:30.511032 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Roles: member,reader Aug 17 07:36:30.512669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_afb93daca17c466da3a698536c6b323f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/afb93daca17c466da3a698536c6b323f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afb93daca17c466da3a698536c6b323f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afb93daca17c466da3a698536c6b323f"}]}] Aug 17 07:36:30.512669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant: tempest-TestVolumeBootPattern-104542181 Aug 17 07:36:30.512669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Id: afb93daca17c466da3a698536c6b323f Aug 17 07:36:30.512669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-Tenant-Name: tempest-TestVolumeBootPattern-104542181 Aug 17 07:36:30.512669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User: tempest-TestVolumeBootPattern-104542181-project Aug 17 07:36:30.512669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Id: default Aug 17 07:36:30.512669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Domain-Name: Default Aug 17 07:36:30.512669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Id: b2e79830079c4aa9b95c4622bac45c74 Aug 17 07:36:30.512669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: X-User-Name: tempest-TestVolumeBootPattern-104542181-project Aug 17 07:36:30.512669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: method: > Aug 17 07:36:30.512669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: exception: Instance da23597a-1e52-4e8a-bd7b-28bd175471ae could not be found. Aug 17 07:36:30.512669 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: action_args: {'id': 'da23597a-1e52-4e8a-bd7b-28bd175471ae'} Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da23597a-1e52-4e8a-bd7b-28bd175471ae could not be found. Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:36:30.513559 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da23597a-1e52-4e8a-bd7b-28bd175471ae could not be found. Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da23597a-1e52-4e8a-bd7b-28bd175471ae could not be found. Aug 17 07:36:30.515166 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: ERROR nova.api.openstack.wsgi Aug 17 07:36:30.516944 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-7d360915-a2d4-4a3f-ba84-0e18be17d314 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Returning 404 to user: Instance da23597a-1e52-4e8a-bd7b-28bd175471ae could not be found. {{(pid=120834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:36:30.516944 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-7d360915-a2d4-4a3f-ba84-0e18be17d314 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 404 len: 111 microversion: 2.1 time: 0.030470 Aug 17 07:36:30.516944 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 508/1016] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:36:30 2022] DELETE /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:36:30.521542 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e26e5f0d-8766-4c38-8f45-595c5d55624c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:30.522299 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e26e5f0d-8766-4c38-8f45-595c5d55624c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] [instance: da23597a-1e52-4e8a-bd7b-28bd175471ae] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:30.525361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=2 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:30.526119 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell0:SELECT=6 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:30.532767 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e26e5f0d-8766-4c38-8f45-595c5d55624c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:30.533246 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e26e5f0d-8766-4c38-8f45-595c5d55624c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:30.533682 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e26e5f0d-8766-4c38-8f45-595c5d55624c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:30.534400 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e26e5f0d-8766-4c38-8f45-595c5d55624c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:30.534854 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e26e5f0d-8766-4c38-8f45-595c5d55624c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:30.535282 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e26e5f0d-8766-4c38-8f45-595c5d55624c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:30.548613 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-e26e5f0d-8766-4c38-8f45-595c5d55624c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] HTTP exception thrown: Instance da23597a-1e52-4e8a-bd7b-28bd175471ae could not be found. Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e26e5f0d-8766-4c38-8f45-595c5d55624c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Request method failure captured: Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae HTTP/1.1 Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JiGZ4T_dzKDjkBCfxbYu3SMuCbXeL9GtrJz4d6Vgz1o2CVvzQTZQ3Z03-yrHmJoojTNWPa7Fyn6tiiPKyLQVpPI6Rcs17J01gqFySOeGI2AajATYblkh1Mm2kzJrmI7RZ-O5R8PMtKAZdvXPwfXv80M8Oer1Cr8HncocvyrtFJFi3Y Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: afb93daca17c466da3a698536c6b323f Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-TestVolumeBootPattern-104542181 Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:36:30.550250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:36:30.551857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_afb93daca17c466da3a698536c6b323f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/afb93daca17c466da3a698536c6b323f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afb93daca17c466da3a698536c6b323f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/afb93daca17c466da3a698536c6b323f"}]}] Aug 17 07:36:30.551857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-TestVolumeBootPattern-104542181 Aug 17 07:36:30.551857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: afb93daca17c466da3a698536c6b323f Aug 17 07:36:30.551857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-TestVolumeBootPattern-104542181 Aug 17 07:36:30.551857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-TestVolumeBootPattern-104542181-project Aug 17 07:36:30.551857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:36:30.551857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:36:30.551857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: b2e79830079c4aa9b95c4622bac45c74 Aug 17 07:36:30.551857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-TestVolumeBootPattern-104542181-project Aug 17 07:36:30.551857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:36:30.551857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance da23597a-1e52-4e8a-bd7b-28bd175471ae could not be found. Aug 17 07:36:30.551857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': 'da23597a-1e52-4e8a-bd7b-28bd175471ae'} Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da23597a-1e52-4e8a-bd7b-28bd175471ae could not be found. Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:36:30.552774 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:36:30.554379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:36:30.554379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:36:30.554379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:36:30.554379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:36:30.554379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:36:30.554379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:36:30.554379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:36:30.554379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da23597a-1e52-4e8a-bd7b-28bd175471ae could not be found. Aug 17 07:36:30.554379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:30.554379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:36:30.554379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:30.554379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:36:30.554379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:36:30.554379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:36:30.554379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:36:30.554379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:36:30.554379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da23597a-1e52-4e8a-bd7b-28bd175471ae could not be found. Aug 17 07:36:30.554379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:30.555731 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e26e5f0d-8766-4c38-8f45-595c5d55624c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Returning 404 to user: Instance da23597a-1e52-4e8a-bd7b-28bd175471ae could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:36:30.555731 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e26e5f0d-8766-4c38-8f45-595c5d55624c tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae" status: 404 len: 111 microversion: 2.1 time: 0.034225 Aug 17 07:36:30.555731 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 509/1017] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:30 2022] GET /compute/v2.1/servers/da23597a-1e52-4e8a-bd7b-28bd175471ae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 07:36:31.839980 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-8c4883ad-f75f-458f-a012-23de6c925a03 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] Calling method '.version_select at 0x7f30ac349a60>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:31.844848 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell0:SELECT=2 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:31.864451 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-8c4883ad-f75f-458f-a012-23de6c925a03 tempest-TestVolumeBootPattern-104542181 tempest-TestVolumeBootPattern-104542181-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-800034190" status: 202 len: 0 microversion: 2.1 time: 0.028711 Aug 17 07:36:31.865024 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 509/1018] 10.222.0.45 () {58 vars in 1260 bytes} [Wed Aug 17 07:36:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-800034190 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:36:34.564530 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 07:36:34.564530 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Wed Aug 17 07:36:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 07:36:47.648193 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-4a29b743-36bb-4674-a5bc-18666b2451dc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:47.648760 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-4a29b743-36bb-4674-a5bc-18666b2451dc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: a27a8693-50d4-46af-ab02-0d7eb95be4e6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:47.651083 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:47.651931 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=6,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:47.659094 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4a29b743-36bb-4674-a5bc-18666b2451dc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:47.659635 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4a29b743-36bb-4674-a5bc-18666b2451dc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:47.660064 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4a29b743-36bb-4674-a5bc-18666b2451dc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:47.660742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4a29b743-36bb-4674-a5bc-18666b2451dc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:47.661187 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4a29b743-36bb-4674-a5bc-18666b2451dc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:47.661606 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4a29b743-36bb-4674-a5bc-18666b2451dc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:47.936503 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.objects.instance [None req-4a29b743-36bb-4674-a5bc-18666b2451dc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lazy-loading 'services' on Instance uuid a27a8693-50d4-46af-ab02-0d7eb95be4e6 {{(pid=120835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:36:48.005553 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-4a29b743-36bb-4674-a5bc-18666b2451dc tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6/os-volume_attachments/4cd6f34e-28aa-418d-850a-82f0b629f16f" status: 202 len: 0 microversion: 2.1 time: 0.361811 Aug 17 07:36:48.006174 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 510/1019] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 17 07:36:47 2022] DELETE /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6/os-volume_attachments/4cd6f34e-28aa-418d-850a-82f0b629f16f => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:36:49.123764 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:49.124548 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:49.128418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c5a5c229-c201-4e7f-b76a-46284e7f9292 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:49.128911 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c5a5c229-c201-4e7f-b76a-46284e7f9292 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: a27a8693-50d4-46af-ab02-0d7eb95be4e6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:49.137675 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c5a5c229-c201-4e7f-b76a-46284e7f9292 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:49.138183 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c5a5c229-c201-4e7f-b76a-46284e7f9292 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:49.138618 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c5a5c229-c201-4e7f-b76a-46284e7f9292 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:49.139301 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c5a5c229-c201-4e7f-b76a-46284e7f9292 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:49.139754 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c5a5c229-c201-4e7f-b76a-46284e7f9292 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:49.140177 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c5a5c229-c201-4e7f-b76a-46284e7f9292 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:49.166294 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c5a5c229-c201-4e7f-b76a-46284e7f9292 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: a27a8693-50d4-46af-ab02-0d7eb95be4e6] Going to try to terminate instance {{(pid=120834) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:36:49.239722 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c5a5c229-c201-4e7f-b76a-46284e7f9292 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6" status: 204 len: 0 microversion: 2.1 time: 0.117216 Aug 17 07:36:49.241112 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 510/1020] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:36:49 2022] DELETE /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:36:49.251503 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-6906d158-5964-4e2e-975b-d58ae6daabb2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:49.252197 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-6906d158-5964-4e2e-975b-d58ae6daabb2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: a27a8693-50d4-46af-ab02-0d7eb95be4e6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:49.258736 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6906d158-5964-4e2e-975b-d58ae6daabb2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:49.259216 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6906d158-5964-4e2e-975b-d58ae6daabb2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:49.259723 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6906d158-5964-4e2e-975b-d58ae6daabb2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:49.260520 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6906d158-5964-4e2e-975b-d58ae6daabb2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:49.260968 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6906d158-5964-4e2e-975b-d58ae6daabb2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:49.261389 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6906d158-5964-4e2e-975b-d58ae6daabb2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:49.394906 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-6906d158-5964-4e2e-975b-d58ae6daabb2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:49.402261 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-6906d158-5964-4e2e-975b-d58ae6daabb2 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6" status: 200 len: 1512 microversion: 2.1 time: 0.155888 Aug 17 07:36:49.402815 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 511/1021] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:49 2022] GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 07:36:50.424039 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-6b5664a7-0be4-49f1-bbbb-8e711be22805 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:50.424758 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-6b5664a7-0be4-49f1-bbbb-8e711be22805 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: a27a8693-50d4-46af-ab02-0d7eb95be4e6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:50.431733 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6b5664a7-0be4-49f1-bbbb-8e711be22805 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:50.432207 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6b5664a7-0be4-49f1-bbbb-8e711be22805 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:50.432638 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6b5664a7-0be4-49f1-bbbb-8e711be22805 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:50.433324 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6b5664a7-0be4-49f1-bbbb-8e711be22805 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:50.433777 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6b5664a7-0be4-49f1-bbbb-8e711be22805 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:50.434245 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-6b5664a7-0be4-49f1-bbbb-8e711be22805 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:50.560638 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-6b5664a7-0be4-49f1-bbbb-8e711be22805 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:50.568118 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-6b5664a7-0be4-49f1-bbbb-8e711be22805 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6" status: 200 len: 1512 microversion: 2.1 time: 0.148358 Aug 17 07:36:50.569300 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 511/1022] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:50 2022] GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:51.331817 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-d5817620-0bbd-41da-961e-213586582656 req-78a030c9-7d88-423a-a583-038319d6fd9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a27a8693-50d4-46af-ab02-0d7eb95be4e6", "name": "network-vif-deleted", "tag": "e97cc00a-e3b6-4eaa-be0a-7f16c6e93086"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:36:51.342844 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-d5817620-0bbd-41da-961e-213586582656 req-78a030c9-7d88-423a-a583-038319d6fd9e service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:51.343363 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-d5817620-0bbd-41da-961e-213586582656 req-78a030c9-7d88-423a-a583-038319d6fd9e service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:51.343785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-d5817620-0bbd-41da-961e-213586582656 req-78a030c9-7d88-423a-a583-038319d6fd9e service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:51.355772 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-d5817620-0bbd-41da-961e-213586582656 req-78a030c9-7d88-423a-a583-038319d6fd9e service nova] Creating event network-vif-deleted:e97cc00a-e3b6-4eaa-be0a-7f16c6e93086 for instance a27a8693-50d4-46af-ab02-0d7eb95be4e6 on hv-cinder-85312 Aug 17 07:36:51.361323 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-d5817620-0bbd-41da-961e-213586582656 req-78a030c9-7d88-423a-a583-038319d6fd9e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034182 Aug 17 07:36:51.361914 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 512/1023] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:36:51.589388 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-b9118c94-0880-4d0b-b730-21f55885ede4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:51.589896 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-b9118c94-0880-4d0b-b730-21f55885ede4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: a27a8693-50d4-46af-ab02-0d7eb95be4e6] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:51.596190 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b9118c94-0880-4d0b-b730-21f55885ede4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:51.596661 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b9118c94-0880-4d0b-b730-21f55885ede4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:51.597088 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b9118c94-0880-4d0b-b730-21f55885ede4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:51.597763 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b9118c94-0880-4d0b-b730-21f55885ede4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:51.598232 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b9118c94-0880-4d0b-b730-21f55885ede4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:51.598650 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b9118c94-0880-4d0b-b730-21f55885ede4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:51.630398 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b9118c94-0880-4d0b-b730-21f55885ede4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:51.630864 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b9118c94-0880-4d0b-b730-21f55885ede4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:51.631788 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-b9118c94-0880-4d0b-b730-21f55885ede4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:51.632219 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.objects.instance [None req-b9118c94-0880-4d0b-b730-21f55885ede4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lazy-loading 'fault' on Instance uuid a27a8693-50d4-46af-ab02-0d7eb95be4e6 {{(pid=120834) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:36:51.676853 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-b9118c94-0880-4d0b-b730-21f55885ede4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2001cc902b3644488a7d9c58cbf5eb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b64dfd6164420ba5ffe3b5c81585f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:36:51.684848 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-b9118c94-0880-4d0b-b730-21f55885ede4 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6" status: 200 len: 1307 microversion: 2.1 time: 0.099440 Aug 17 07:36:51.685402 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 512/1024] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:51 2022] GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6 => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:36:52.707036 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-6d7825c8-d09a-43ac-b85b-d2f489bb1e08 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:36:52.707775 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-6d7825c8-d09a-43ac-b85b-d2f489bb1e08 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] [instance: a27a8693-50d4-46af-ab02-0d7eb95be4e6] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:36:52.714394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6d7825c8-d09a-43ac-b85b-d2f489bb1e08 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:52.714881 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6d7825c8-d09a-43ac-b85b-d2f489bb1e08 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:52.715308 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6d7825c8-d09a-43ac-b85b-d2f489bb1e08 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:52.715995 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6d7825c8-d09a-43ac-b85b-d2f489bb1e08 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:36:52.716449 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6d7825c8-d09a-43ac-b85b-d2f489bb1e08 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:36:52.716872 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6d7825c8-d09a-43ac-b85b-d2f489bb1e08 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:36:52.730618 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-6d7825c8-d09a-43ac-b85b-d2f489bb1e08 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] HTTP exception thrown: Instance a27a8693-50d4-46af-ab02-0d7eb95be4e6 could not be found. Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-6d7825c8-d09a-43ac-b85b-d2f489bb1e08 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Request method failure captured: Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6 HTTP/1.1 Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_JoaGzw0CStpKQzgM3Q2aBw7ROq4VRdRFMaztb-5fw4Ss_m89rqPocRWYrWdr83U_-GpAQkMgPrDfO6rSbe1RQz_7t_gGbv4rww5zgmcLZEx1Zkd9Lin-H9TxweQtBJP3bd8XXwlvoppJu_dw-e9m1roRvL-OPvyT19x2TA41QU2fKg Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 25b64dfd6164420ba5ffe3b5c81585f2 Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1736775012 Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:36:52.732200 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:36:52.733718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_25b64dfd6164420ba5ffe3b5c81585f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/25b64dfd6164420ba5ffe3b5c81585f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/25b64dfd6164420ba5ffe3b5c81585f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/25b64dfd6164420ba5ffe3b5c81585f2"}]}] Aug 17 07:36:52.733718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-VolumesSnapshotTestJSON-1736775012 Aug 17 07:36:52.733718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 25b64dfd6164420ba5ffe3b5c81585f2 Aug 17 07:36:52.733718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1736775012 Aug 17 07:36:52.733718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-VolumesSnapshotTestJSON-1736775012-project Aug 17 07:36:52.733718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:36:52.733718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:36:52.733718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: 2001cc902b3644488a7d9c58cbf5eb58 Aug 17 07:36:52.733718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-VolumesSnapshotTestJSON-1736775012-project Aug 17 07:36:52.733718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:36:52.733718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance a27a8693-50d4-46af-ab02-0d7eb95be4e6 could not be found. Aug 17 07:36:52.733718 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': 'a27a8693-50d4-46af-ab02-0d7eb95be4e6'} Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a27a8693-50d4-46af-ab02-0d7eb95be4e6 could not be found. Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:36:52.734654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:36:52.736271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:36:52.736271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:36:52.736271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:36:52.736271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:36:52.736271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:36:52.736271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:36:52.736271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:36:52.736271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a27a8693-50d4-46af-ab02-0d7eb95be4e6 could not be found. Aug 17 07:36:52.736271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:52.736271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:36:52.736271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:52.736271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:36:52.736271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:36:52.736271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:36:52.736271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:36:52.736271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:36:52.736271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a27a8693-50d4-46af-ab02-0d7eb95be4e6 could not be found. Aug 17 07:36:52.736271 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:36:52.737750 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-6d7825c8-d09a-43ac-b85b-d2f489bb1e08 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] Returning 404 to user: Instance a27a8693-50d4-46af-ab02-0d7eb95be4e6 could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:36:52.737750 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-6d7825c8-d09a-43ac-b85b-d2f489bb1e08 tempest-VolumesSnapshotTestJSON-1736775012 tempest-VolumesSnapshotTestJSON-1736775012-project] 10.222.0.45 "GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6" status: 404 len: 111 microversion: 2.1 time: 0.031278 Aug 17 07:36:52.737750 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 513/1025] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:36:52 2022] GET /compute/v2.1/servers/a27a8693-50d4-46af-ab02-0d7eb95be4e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:38:18.430943 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:38:18.431737 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:38:18.435984 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-87e72683-2ba5-4983-99ca-5fde6104439b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:38:18.436507 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-87e72683-2ba5-4983-99ca-5fde6104439b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:18.443738 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-87e72683-2ba5-4983-99ca-5fde6104439b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:18.444295 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-87e72683-2ba5-4983-99ca-5fde6104439b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:18.444727 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-87e72683-2ba5-4983-99ca-5fde6104439b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:18.445401 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-87e72683-2ba5-4983-99ca-5fde6104439b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:18.446552 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-87e72683-2ba5-4983-99ca-5fde6104439b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:18.446974 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-87e72683-2ba5-4983-99ca-5fde6104439b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:18.469115 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.objects.instance [None req-87e72683-2ba5-4983-99ca-5fde6104439b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lazy-loading 'flavor' on Instance uuid 4e628869-f998-4c45-a905-3dd276ca94f5 {{(pid=120834) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 07:38:18.536838 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-87e72683-2ba5-4983-99ca-5fde6104439b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "POST /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5/action" status: 202 len: 0 microversion: 2.1 time: 0.108222 Aug 17 07:38:18.537417 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 513/1026] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 17 07:38:18 2022] POST /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:38:18.543792 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=8 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:38:18.544650 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:38:18.549109 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-aea9a702-36c1-4363-9401-c99a2a987846 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:18.549724 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-aea9a702-36c1-4363-9401-c99a2a987846 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:18.557713 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aea9a702-36c1-4363-9401-c99a2a987846 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:18.558395 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aea9a702-36c1-4363-9401-c99a2a987846 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:18.558842 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aea9a702-36c1-4363-9401-c99a2a987846 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:18.559536 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aea9a702-36c1-4363-9401-c99a2a987846 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:18.559991 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aea9a702-36c1-4363-9401-c99a2a987846 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:18.560418 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-aea9a702-36c1-4363-9401-c99a2a987846 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:18.695448 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-aea9a702-36c1-4363-9401-c99a2a987846 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:18.702998 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-aea9a702-36c1-4363-9401-c99a2a987846 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1569 microversion: 2.1 time: 0.161239 Aug 17 07:38:18.703557 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 514/1027] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:18 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:19.725021 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f65504d4-2a43-4f6d-898d-373959b0ce91 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:19.725712 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f65504d4-2a43-4f6d-898d-373959b0ce91 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:19.731768 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f65504d4-2a43-4f6d-898d-373959b0ce91 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:19.732239 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f65504d4-2a43-4f6d-898d-373959b0ce91 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:19.732667 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f65504d4-2a43-4f6d-898d-373959b0ce91 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:19.733344 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f65504d4-2a43-4f6d-898d-373959b0ce91 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:19.733789 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f65504d4-2a43-4f6d-898d-373959b0ce91 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:19.734239 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f65504d4-2a43-4f6d-898d-373959b0ce91 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:19.969894 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f65504d4-2a43-4f6d-898d-373959b0ce91 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:19.977360 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f65504d4-2a43-4f6d-898d-373959b0ce91 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1569 microversion: 2.1 time: 0.257386 Aug 17 07:38:19.977848 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 514/1028] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:19 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1569 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:20.998277 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-358833f3-715d-4c38-97ca-af46cafc5084 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:20.998895 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-358833f3-715d-4c38-97ca-af46cafc5084 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:21.005473 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-358833f3-715d-4c38-97ca-af46cafc5084 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:21.005985 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-358833f3-715d-4c38-97ca-af46cafc5084 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:21.006425 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-358833f3-715d-4c38-97ca-af46cafc5084 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:21.007118 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-358833f3-715d-4c38-97ca-af46cafc5084 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:21.007569 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-358833f3-715d-4c38-97ca-af46cafc5084 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:21.007996 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-358833f3-715d-4c38-97ca-af46cafc5084 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:21.140394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-358833f3-715d-4c38-97ca-af46cafc5084 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:21.147957 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-358833f3-715d-4c38-97ca-af46cafc5084 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1569 microversion: 2.1 time: 0.153574 Aug 17 07:38:21.148530 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 515/1029] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:20 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:22.169089 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-d1480b8e-5d44-4137-9474-0b37ab987f10 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:22.169682 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-d1480b8e-5d44-4137-9474-0b37ab987f10 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:22.176081 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d1480b8e-5d44-4137-9474-0b37ab987f10 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:22.176548 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d1480b8e-5d44-4137-9474-0b37ab987f10 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:22.176976 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d1480b8e-5d44-4137-9474-0b37ab987f10 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:22.177653 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d1480b8e-5d44-4137-9474-0b37ab987f10 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:22.178134 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d1480b8e-5d44-4137-9474-0b37ab987f10 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:22.178561 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d1480b8e-5d44-4137-9474-0b37ab987f10 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:22.307947 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-d1480b8e-5d44-4137-9474-0b37ab987f10 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:22.315317 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-d1480b8e-5d44-4137-9474-0b37ab987f10 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1569 microversion: 2.1 time: 0.150664 Aug 17 07:38:22.315866 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 515/1030] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:22 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:23.336139 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-21531929-fc2e-4c00-bf51-7222b13e1f52 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:23.336749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-21531929-fc2e-4c00-bf51-7222b13e1f52 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:23.343173 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-21531929-fc2e-4c00-bf51-7222b13e1f52 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:23.343651 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-21531929-fc2e-4c00-bf51-7222b13e1f52 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:23.344089 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-21531929-fc2e-4c00-bf51-7222b13e1f52 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:23.344775 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-21531929-fc2e-4c00-bf51-7222b13e1f52 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:23.345229 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-21531929-fc2e-4c00-bf51-7222b13e1f52 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:23.345654 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-21531929-fc2e-4c00-bf51-7222b13e1f52 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:23.473194 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-21531929-fc2e-4c00-bf51-7222b13e1f52 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:23.481240 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-21531929-fc2e-4c00-bf51-7222b13e1f52 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1569 microversion: 2.1 time: 0.149056 Aug 17 07:38:23.481799 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 516/1031] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:23 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:24.502465 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-9b21924d-7c5a-4eb2-85e9-34dfa5caa9df tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:24.503098 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-9b21924d-7c5a-4eb2-85e9-34dfa5caa9df tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:24.510084 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9b21924d-7c5a-4eb2-85e9-34dfa5caa9df tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:24.510555 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9b21924d-7c5a-4eb2-85e9-34dfa5caa9df tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:24.510984 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9b21924d-7c5a-4eb2-85e9-34dfa5caa9df tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:24.511681 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9b21924d-7c5a-4eb2-85e9-34dfa5caa9df tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:24.512107 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9b21924d-7c5a-4eb2-85e9-34dfa5caa9df tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:24.512526 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-9b21924d-7c5a-4eb2-85e9-34dfa5caa9df tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:24.642555 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-9b21924d-7c5a-4eb2-85e9-34dfa5caa9df tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:24.649906 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-9b21924d-7c5a-4eb2-85e9-34dfa5caa9df tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1569 microversion: 2.1 time: 0.151323 Aug 17 07:38:24.650482 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 516/1032] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:24 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:25.670812 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-937386ae-122c-42c8-bfd3-491c64b3053b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:25.671347 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-937386ae-122c-42c8-bfd3-491c64b3053b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:25.677729 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-937386ae-122c-42c8-bfd3-491c64b3053b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:25.678250 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-937386ae-122c-42c8-bfd3-491c64b3053b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:25.678687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-937386ae-122c-42c8-bfd3-491c64b3053b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:25.679375 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-937386ae-122c-42c8-bfd3-491c64b3053b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:25.679833 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-937386ae-122c-42c8-bfd3-491c64b3053b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:25.680257 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-937386ae-122c-42c8-bfd3-491c64b3053b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:25.806273 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-937386ae-122c-42c8-bfd3-491c64b3053b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:25.813638 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-937386ae-122c-42c8-bfd3-491c64b3053b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1569 microversion: 2.1 time: 0.146875 Aug 17 07:38:25.814231 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 517/1033] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:25 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:26.835472 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-08066aea-2848-41e2-a21f-87ecf8bbf096 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:26.836614 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-08066aea-2848-41e2-a21f-87ecf8bbf096 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:26.843048 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-08066aea-2848-41e2-a21f-87ecf8bbf096 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:26.843524 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-08066aea-2848-41e2-a21f-87ecf8bbf096 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:26.843955 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-08066aea-2848-41e2-a21f-87ecf8bbf096 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:26.844643 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-08066aea-2848-41e2-a21f-87ecf8bbf096 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:26.845093 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-08066aea-2848-41e2-a21f-87ecf8bbf096 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:26.845512 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-08066aea-2848-41e2-a21f-87ecf8bbf096 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:26.975592 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-08066aea-2848-41e2-a21f-87ecf8bbf096 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:26.983047 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-08066aea-2848-41e2-a21f-87ecf8bbf096 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1569 microversion: 2.1 time: 0.151482 Aug 17 07:38:26.983596 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 517/1034] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:26 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:28.004115 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-16763dee-e5f8-4c10-93ec-5fbc6e785be3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:28.004727 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-16763dee-e5f8-4c10-93ec-5fbc6e785be3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:28.011143 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-16763dee-e5f8-4c10-93ec-5fbc6e785be3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:28.011651 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-16763dee-e5f8-4c10-93ec-5fbc6e785be3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:28.012092 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-16763dee-e5f8-4c10-93ec-5fbc6e785be3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:28.012781 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-16763dee-e5f8-4c10-93ec-5fbc6e785be3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:28.013233 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-16763dee-e5f8-4c10-93ec-5fbc6e785be3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:28.013659 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-16763dee-e5f8-4c10-93ec-5fbc6e785be3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:28.142521 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-16763dee-e5f8-4c10-93ec-5fbc6e785be3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:28.150487 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-16763dee-e5f8-4c10-93ec-5fbc6e785be3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1569 microversion: 2.1 time: 0.150238 Aug 17 07:38:28.151046 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 518/1035] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:27 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:29.171402 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-3a5c3698-c7fd-46cd-a840-6e1cdea510b5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:29.172015 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-3a5c3698-c7fd-46cd-a840-6e1cdea510b5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:29.178492 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3a5c3698-c7fd-46cd-a840-6e1cdea510b5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:29.178907 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3a5c3698-c7fd-46cd-a840-6e1cdea510b5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:29.179334 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3a5c3698-c7fd-46cd-a840-6e1cdea510b5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:29.180682 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3a5c3698-c7fd-46cd-a840-6e1cdea510b5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:29.181133 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3a5c3698-c7fd-46cd-a840-6e1cdea510b5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:29.181553 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3a5c3698-c7fd-46cd-a840-6e1cdea510b5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:29.314284 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-3a5c3698-c7fd-46cd-a840-6e1cdea510b5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:29.321625 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-3a5c3698-c7fd-46cd-a840-6e1cdea510b5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1569 microversion: 2.1 time: 0.154163 Aug 17 07:38:29.322224 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 518/1036] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:29 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:30.342800 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-78c581eb-b02c-40bf-8e05-8de694510d1c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:30.343421 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-78c581eb-b02c-40bf-8e05-8de694510d1c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:30.350269 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-78c581eb-b02c-40bf-8e05-8de694510d1c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:30.350816 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-78c581eb-b02c-40bf-8e05-8de694510d1c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:30.351258 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-78c581eb-b02c-40bf-8e05-8de694510d1c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:30.352270 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-78c581eb-b02c-40bf-8e05-8de694510d1c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:30.352479 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-78c581eb-b02c-40bf-8e05-8de694510d1c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:30.352909 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-78c581eb-b02c-40bf-8e05-8de694510d1c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:30.485052 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-78c581eb-b02c-40bf-8e05-8de694510d1c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:30.493047 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-78c581eb-b02c-40bf-8e05-8de694510d1c tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1569 microversion: 2.1 time: 0.153669 Aug 17 07:38:30.493867 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 519/1037] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:30 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:31.514016 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-47c29b1b-2cab-4739-b5a8-740a4914bb4e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:31.514622 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-47c29b1b-2cab-4739-b5a8-740a4914bb4e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:31.520978 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-47c29b1b-2cab-4739-b5a8-740a4914bb4e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:31.521453 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-47c29b1b-2cab-4739-b5a8-740a4914bb4e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:31.521889 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-47c29b1b-2cab-4739-b5a8-740a4914bb4e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:31.522599 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-47c29b1b-2cab-4739-b5a8-740a4914bb4e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:31.523048 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-47c29b1b-2cab-4739-b5a8-740a4914bb4e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:31.523470 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-47c29b1b-2cab-4739-b5a8-740a4914bb4e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:31.651096 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-47c29b1b-2cab-4739-b5a8-740a4914bb4e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:31.658553 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-47c29b1b-2cab-4739-b5a8-740a4914bb4e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1510 microversion: 2.1 time: 0.148514 Aug 17 07:38:31.659102 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 519/1038] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:31 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:31.680001 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-04fdf775-7fc7-4567-9cad-42585a29208f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:38:31.680595 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-04fdf775-7fc7-4567-9cad-42585a29208f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:31.687031 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-04fdf775-7fc7-4567-9cad-42585a29208f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:31.687508 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-04fdf775-7fc7-4567-9cad-42585a29208f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:31.687939 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-04fdf775-7fc7-4567-9cad-42585a29208f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:31.688622 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-04fdf775-7fc7-4567-9cad-42585a29208f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:31.689070 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-04fdf775-7fc7-4567-9cad-42585a29208f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:31.689540 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-04fdf775-7fc7-4567-9cad-42585a29208f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:31.717884 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-04fdf775-7fc7-4567-9cad-42585a29208f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120835) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 07:38:31.780434 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-04fdf775-7fc7-4567-9cad-42585a29208f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "POST /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5/action" status: 202 len: 0 microversion: 2.1 time: 0.105992 Aug 17 07:38:31.781033 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 520/1039] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 17 07:38:31 2022] POST /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:38:31.788977 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-acde36cb-552e-4fe6-b0ab-cb8587fe0c0d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:31.789586 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-acde36cb-552e-4fe6-b0ab-cb8587fe0c0d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:31.795436 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-acde36cb-552e-4fe6-b0ab-cb8587fe0c0d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:31.795987 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-acde36cb-552e-4fe6-b0ab-cb8587fe0c0d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:31.796491 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-acde36cb-552e-4fe6-b0ab-cb8587fe0c0d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:31.797260 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-acde36cb-552e-4fe6-b0ab-cb8587fe0c0d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:31.797791 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-acde36cb-552e-4fe6-b0ab-cb8587fe0c0d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:31.798244 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-acde36cb-552e-4fe6-b0ab-cb8587fe0c0d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:31.942004 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-acde36cb-552e-4fe6-b0ab-cb8587fe0c0d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:31.950610 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-acde36cb-552e-4fe6-b0ab-cb8587fe0c0d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1518 microversion: 2.1 time: 0.165437 Aug 17 07:38:31.951172 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 520/1040] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:31 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:32.971679 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-17db5873-1a94-46c3-8009-8aadd76d85b7 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:32.972298 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-17db5873-1a94-46c3-8009-8aadd76d85b7 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:32.978374 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-17db5873-1a94-46c3-8009-8aadd76d85b7 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:32.978856 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-17db5873-1a94-46c3-8009-8aadd76d85b7 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:32.979296 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-17db5873-1a94-46c3-8009-8aadd76d85b7 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:32.979991 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-17db5873-1a94-46c3-8009-8aadd76d85b7 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:32.980447 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-17db5873-1a94-46c3-8009-8aadd76d85b7 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:32.980877 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-17db5873-1a94-46c3-8009-8aadd76d85b7 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:33.118731 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-17db5873-1a94-46c3-8009-8aadd76d85b7 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:33.126255 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-17db5873-1a94-46c3-8009-8aadd76d85b7 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1518 microversion: 2.1 time: 0.158923 Aug 17 07:38:33.126900 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 521/1041] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:32 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:34.149040 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-d57af5a2-95af-4b47-84c1-2cef1302319d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:34.149593 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-d57af5a2-95af-4b47-84c1-2cef1302319d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:34.155943 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d57af5a2-95af-4b47-84c1-2cef1302319d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:34.156424 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d57af5a2-95af-4b47-84c1-2cef1302319d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:34.156857 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d57af5a2-95af-4b47-84c1-2cef1302319d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:34.157541 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d57af5a2-95af-4b47-84c1-2cef1302319d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:34.158011 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d57af5a2-95af-4b47-84c1-2cef1302319d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:34.158439 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-d57af5a2-95af-4b47-84c1-2cef1302319d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:34.292159 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-d57af5a2-95af-4b47-84c1-2cef1302319d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:34.299664 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-d57af5a2-95af-4b47-84c1-2cef1302319d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1518 microversion: 2.1 time: 0.155104 Aug 17 07:38:34.300214 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 521/1042] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:34 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:35.320687 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-1bfa2a87-87a9-407e-b3e8-6254da7a0136 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:35.321302 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-1bfa2a87-87a9-407e-b3e8-6254da7a0136 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:35.327659 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1bfa2a87-87a9-407e-b3e8-6254da7a0136 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:35.328138 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1bfa2a87-87a9-407e-b3e8-6254da7a0136 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:35.328605 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1bfa2a87-87a9-407e-b3e8-6254da7a0136 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:35.329296 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1bfa2a87-87a9-407e-b3e8-6254da7a0136 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:35.329749 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1bfa2a87-87a9-407e-b3e8-6254da7a0136 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:35.330216 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-1bfa2a87-87a9-407e-b3e8-6254da7a0136 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:35.467952 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-1bfa2a87-87a9-407e-b3e8-6254da7a0136 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:35.477612 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-1bfa2a87-87a9-407e-b3e8-6254da7a0136 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1518 microversion: 2.1 time: 0.160124 Aug 17 07:38:35.478137 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 522/1043] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:35 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:35.500744 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [req-6ea6a80c-0814-4e35-b190-4e153f1c01c5 req-3b2e844f-0f57-4eef-89d3-4d07597d979d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e628869-f998-4c45-a905-3dd276ca94f5", "name": "network-vif-unplugged", "status": "completed", "tag": "9baee402-152f-4aa2-a956-c2704e4b760c"}]} {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:38:35.510710 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-6ea6a80c-0814-4e35-b190-4e153f1c01c5 req-3b2e844f-0f57-4eef-89d3-4d07597d979d service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:35.511193 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-6ea6a80c-0814-4e35-b190-4e153f1c01c5 req-3b2e844f-0f57-4eef-89d3-4d07597d979d service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:35.511624 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [req-6ea6a80c-0814-4e35-b190-4e153f1c01c5 req-3b2e844f-0f57-4eef-89d3-4d07597d979d service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:35.522909 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.compute.server_external_events [req-6ea6a80c-0814-4e35-b190-4e153f1c01c5 req-3b2e844f-0f57-4eef-89d3-4d07597d979d service nova] Unable to find a host for instance 4e628869-f998-4c45-a905-3dd276ca94f5. Dropping event network-vif-unplugged {{(pid=120834) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 17 07:38:35.524295 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [req-6ea6a80c-0814-4e35-b190-4e153f1c01c5 req-3b2e844f-0f57-4eef-89d3-4d07597d979d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.098371 Aug 17 07:38:35.524869 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 522/1044] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 100 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 17 07:38:36.499938 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-4979bd2f-1a04-4aa3-a53f-88f8b82cc37d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:36.500556 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-4979bd2f-1a04-4aa3-a53f-88f8b82cc37d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:36.507061 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4979bd2f-1a04-4aa3-a53f-88f8b82cc37d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:36.507545 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4979bd2f-1a04-4aa3-a53f-88f8b82cc37d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:36.508645 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4979bd2f-1a04-4aa3-a53f-88f8b82cc37d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:36.509343 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4979bd2f-1a04-4aa3-a53f-88f8b82cc37d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:36.509800 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4979bd2f-1a04-4aa3-a53f-88f8b82cc37d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:36.510267 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-4979bd2f-1a04-4aa3-a53f-88f8b82cc37d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:36.641856 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-4979bd2f-1a04-4aa3-a53f-88f8b82cc37d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:36.654085 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-4979bd2f-1a04-4aa3-a53f-88f8b82cc37d tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1518 microversion: 2.1 time: 0.158250 Aug 17 07:38:36.654677 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 523/1045] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:36 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:37.675650 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c42187fd-1022-4a9b-88ef-e5414004dfe5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:37.676289 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c42187fd-1022-4a9b-88ef-e5414004dfe5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:37.683506 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c42187fd-1022-4a9b-88ef-e5414004dfe5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:37.684011 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c42187fd-1022-4a9b-88ef-e5414004dfe5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:37.684446 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c42187fd-1022-4a9b-88ef-e5414004dfe5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:37.685129 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c42187fd-1022-4a9b-88ef-e5414004dfe5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:37.685581 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c42187fd-1022-4a9b-88ef-e5414004dfe5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:37.686027 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c42187fd-1022-4a9b-88ef-e5414004dfe5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:37.815750 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c42187fd-1022-4a9b-88ef-e5414004dfe5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:37.823428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c42187fd-1022-4a9b-88ef-e5414004dfe5 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1576 microversion: 2.1 time: 0.151604 Aug 17 07:38:37.823990 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 523/1046] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:37 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:38.844907 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-ae4f571d-e9a4-4f8a-972b-6c7e0078b7c3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:38.845529 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-ae4f571d-e9a4-4f8a-972b-6c7e0078b7c3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:38.852487 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ae4f571d-e9a4-4f8a-972b-6c7e0078b7c3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:38.852958 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ae4f571d-e9a4-4f8a-972b-6c7e0078b7c3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:38.853394 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ae4f571d-e9a4-4f8a-972b-6c7e0078b7c3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:38.854106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ae4f571d-e9a4-4f8a-972b-6c7e0078b7c3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:38.854557 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ae4f571d-e9a4-4f8a-972b-6c7e0078b7c3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:38.854982 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-ae4f571d-e9a4-4f8a-972b-6c7e0078b7c3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:38.987387 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-ae4f571d-e9a4-4f8a-972b-6c7e0078b7c3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:38.995713 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-ae4f571d-e9a4-4f8a-972b-6c7e0078b7c3 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1576 microversion: 2.1 time: 0.154710 Aug 17 07:38:38.996275 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 524/1047] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:38 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:40.016195 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-f8ebaab8-62a2-49be-a980-c354303c1b62 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:40.016826 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-f8ebaab8-62a2-49be-a980-c354303c1b62 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:40.023321 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f8ebaab8-62a2-49be-a980-c354303c1b62 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:40.023792 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f8ebaab8-62a2-49be-a980-c354303c1b62 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:40.024220 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f8ebaab8-62a2-49be-a980-c354303c1b62 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:40.025410 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f8ebaab8-62a2-49be-a980-c354303c1b62 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:40.025853 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f8ebaab8-62a2-49be-a980-c354303c1b62 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:40.026297 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-f8ebaab8-62a2-49be-a980-c354303c1b62 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:40.152207 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-f8ebaab8-62a2-49be-a980-c354303c1b62 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:40.159877 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-f8ebaab8-62a2-49be-a980-c354303c1b62 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1576 microversion: 2.1 time: 0.147274 Aug 17 07:38:40.160435 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 524/1048] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:40 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:41.181031 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-6bce5fb6-cbbf-4dc8-8e1e-3c78be680fc9 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:41.181650 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-6bce5fb6-cbbf-4dc8-8e1e-3c78be680fc9 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:41.188825 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6bce5fb6-cbbf-4dc8-8e1e-3c78be680fc9 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:41.189306 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6bce5fb6-cbbf-4dc8-8e1e-3c78be680fc9 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:41.189745 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6bce5fb6-cbbf-4dc8-8e1e-3c78be680fc9 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:41.190476 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6bce5fb6-cbbf-4dc8-8e1e-3c78be680fc9 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:41.190932 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6bce5fb6-cbbf-4dc8-8e1e-3c78be680fc9 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:41.191361 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-6bce5fb6-cbbf-4dc8-8e1e-3c78be680fc9 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:41.325363 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-6bce5fb6-cbbf-4dc8-8e1e-3c78be680fc9 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:41.332933 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-6bce5fb6-cbbf-4dc8-8e1e-3c78be680fc9 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1576 microversion: 2.1 time: 0.155808 Aug 17 07:38:41.333493 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 525/1049] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:41 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:42.353566 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-4cc54586-4a6c-42fe-86b6-b6e7a4a3bd93 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:42.354820 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-4cc54586-4a6c-42fe-86b6-b6e7a4a3bd93 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:42.361146 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4cc54586-4a6c-42fe-86b6-b6e7a4a3bd93 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:42.361618 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4cc54586-4a6c-42fe-86b6-b6e7a4a3bd93 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:42.362075 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4cc54586-4a6c-42fe-86b6-b6e7a4a3bd93 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:42.362758 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4cc54586-4a6c-42fe-86b6-b6e7a4a3bd93 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:42.363202 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4cc54586-4a6c-42fe-86b6-b6e7a4a3bd93 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:42.363622 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-4cc54586-4a6c-42fe-86b6-b6e7a4a3bd93 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:42.491322 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-4cc54586-4a6c-42fe-86b6-b6e7a4a3bd93 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:42.499013 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-4cc54586-4a6c-42fe-86b6-b6e7a4a3bd93 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1576 microversion: 2.1 time: 0.149343 Aug 17 07:38:42.499608 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 525/1050] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:42 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:43.518684 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-67166e89-7b1a-43a1-a4e0-21f3b293294e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:43.519305 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-67166e89-7b1a-43a1-a4e0-21f3b293294e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:43.525730 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-67166e89-7b1a-43a1-a4e0-21f3b293294e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:43.526246 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-67166e89-7b1a-43a1-a4e0-21f3b293294e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:43.526696 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-67166e89-7b1a-43a1-a4e0-21f3b293294e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:43.527391 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-67166e89-7b1a-43a1-a4e0-21f3b293294e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:43.527848 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-67166e89-7b1a-43a1-a4e0-21f3b293294e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:43.528281 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-67166e89-7b1a-43a1-a4e0-21f3b293294e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:43.655274 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-67166e89-7b1a-43a1-a4e0-21f3b293294e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:43.662875 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-67166e89-7b1a-43a1-a4e0-21f3b293294e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1576 microversion: 2.1 time: 0.148045 Aug 17 07:38:43.663436 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 526/1051] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:43 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:44.685136 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-3c323f69-7723-4c77-8425-1b37fdbe7cab tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:44.685654 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-3c323f69-7723-4c77-8425-1b37fdbe7cab tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:44.691637 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3c323f69-7723-4c77-8425-1b37fdbe7cab tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:44.692107 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3c323f69-7723-4c77-8425-1b37fdbe7cab tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:44.692533 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3c323f69-7723-4c77-8425-1b37fdbe7cab tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:44.693218 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3c323f69-7723-4c77-8425-1b37fdbe7cab tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:44.693661 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3c323f69-7723-4c77-8425-1b37fdbe7cab tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:44.694122 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3c323f69-7723-4c77-8425-1b37fdbe7cab tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:44.826079 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-3c323f69-7723-4c77-8425-1b37fdbe7cab tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:44.833413 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-3c323f69-7723-4c77-8425-1b37fdbe7cab tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1576 microversion: 2.1 time: 0.152854 Aug 17 07:38:44.833990 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 526/1052] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:44 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:45.853897 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-13ed1d64-d4fb-4bba-890c-63f9da5929a1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:45.854544 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-13ed1d64-d4fb-4bba-890c-63f9da5929a1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:45.861023 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-13ed1d64-d4fb-4bba-890c-63f9da5929a1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:45.861510 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-13ed1d64-d4fb-4bba-890c-63f9da5929a1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:45.861949 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-13ed1d64-d4fb-4bba-890c-63f9da5929a1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:45.862674 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-13ed1d64-d4fb-4bba-890c-63f9da5929a1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:45.863129 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-13ed1d64-d4fb-4bba-890c-63f9da5929a1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:45.863564 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-13ed1d64-d4fb-4bba-890c-63f9da5929a1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:46.011731 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-13ed1d64-d4fb-4bba-890c-63f9da5929a1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:46.019177 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-13ed1d64-d4fb-4bba-890c-63f9da5929a1 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1576 microversion: 2.1 time: 0.169230 Aug 17 07:38:46.019741 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 527/1053] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:45 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:47.039694 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-3b98bb2b-3ca1-4b39-8913-7b21755f13ac tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:47.040304 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-3b98bb2b-3ca1-4b39-8913-7b21755f13ac tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:47.047279 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3b98bb2b-3ca1-4b39-8913-7b21755f13ac tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:47.047758 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3b98bb2b-3ca1-4b39-8913-7b21755f13ac tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:47.048197 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3b98bb2b-3ca1-4b39-8913-7b21755f13ac tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:47.048918 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3b98bb2b-3ca1-4b39-8913-7b21755f13ac tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:47.049372 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3b98bb2b-3ca1-4b39-8913-7b21755f13ac tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:47.049799 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3b98bb2b-3ca1-4b39-8913-7b21755f13ac tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:47.180813 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-3b98bb2b-3ca1-4b39-8913-7b21755f13ac tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:47.188348 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-3b98bb2b-3ca1-4b39-8913-7b21755f13ac tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1576 microversion: 2.1 time: 0.152540 Aug 17 07:38:47.188905 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 527/1054] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:47 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:47.514791 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-5ace30b1-3458-43ae-b3d1-5ee058476d11 req-a6bcda30-d7fd-4152-abc5-e3308df10b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e628869-f998-4c45-a905-3dd276ca94f5", "name": "network-vif-plugged", "status": "completed", "tag": "9baee402-152f-4aa2-a956-c2704e4b760c"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:38:47.525328 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-5ace30b1-3458-43ae-b3d1-5ee058476d11 req-a6bcda30-d7fd-4152-abc5-e3308df10b60 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:47.525860 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-5ace30b1-3458-43ae-b3d1-5ee058476d11 req-a6bcda30-d7fd-4152-abc5-e3308df10b60 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:47.526322 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-5ace30b1-3458-43ae-b3d1-5ee058476d11 req-a6bcda30-d7fd-4152-abc5-e3308df10b60 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:47.537316 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-5ace30b1-3458-43ae-b3d1-5ee058476d11 req-a6bcda30-d7fd-4152-abc5-e3308df10b60 service nova] Creating event network-vif-plugged:9baee402-152f-4aa2-a956-c2704e4b760c for instance 4e628869-f998-4c45-a905-3dd276ca94f5 on hv-cinder-85312 Aug 17 07:38:47.542951 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-5ace30b1-3458-43ae-b3d1-5ee058476d11 req-a6bcda30-d7fd-4152-abc5-e3308df10b60 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031950 Aug 17 07:38:47.543127 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 528/1055] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:38:48.075165 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 07:38:48.075696 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Wed Aug 17 07:38:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 07:38:48.209354 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c6aa52fd-08c3-4919-8d3e-e15d365dd911 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:48.209994 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c6aa52fd-08c3-4919-8d3e-e15d365dd911 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:48.216948 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c6aa52fd-08c3-4919-8d3e-e15d365dd911 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:48.217428 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c6aa52fd-08c3-4919-8d3e-e15d365dd911 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:48.217864 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c6aa52fd-08c3-4919-8d3e-e15d365dd911 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:48.218581 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c6aa52fd-08c3-4919-8d3e-e15d365dd911 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:48.219039 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c6aa52fd-08c3-4919-8d3e-e15d365dd911 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:48.219464 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c6aa52fd-08c3-4919-8d3e-e15d365dd911 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:48.224126 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:38:48.349546 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c6aa52fd-08c3-4919-8d3e-e15d365dd911 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:48.357738 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c6aa52fd-08c3-4919-8d3e-e15d365dd911 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1576 microversion: 2.1 time: 0.152306 Aug 17 07:38:48.358321 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 528/1056] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:48 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:38:49.380144 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-84af1f36-11b5-49b2-96d2-cafce0bdea2b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:38:49.380841 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-84af1f36-11b5-49b2-96d2-cafce0bdea2b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:38:49.383973 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:38:49.388040 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-84af1f36-11b5-49b2-96d2-cafce0bdea2b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:49.388514 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-84af1f36-11b5-49b2-96d2-cafce0bdea2b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:49.388939 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-84af1f36-11b5-49b2-96d2-cafce0bdea2b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:49.389625 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-84af1f36-11b5-49b2-96d2-cafce0bdea2b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:38:49.390106 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-84af1f36-11b5-49b2-96d2-cafce0bdea2b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:38:49.390520 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-84af1f36-11b5-49b2-96d2-cafce0bdea2b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:38:49.393870 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:38:49.523496 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-84af1f36-11b5-49b2-96d2-cafce0bdea2b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:38:49.531020 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-84af1f36-11b5-49b2-96d2-cafce0bdea2b tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1563 microversion: 2.1 time: 0.155856 Aug 17 07:38:49.531577 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 529/1057] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:38:49 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:39:54.573397 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 07:39:54.574047 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Wed Aug 17 07:39:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 07:40:03.129619 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_api:SELECT=32 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:40:03.130543 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG dbcounter [-] [120834] Writing DB stats nova_cell1:SELECT=4 {{(pid=120834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:40:03.131301 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_api:SELECT=1 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:40:03.132078 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG dbcounter [-] [120835] Writing DB stats nova_cell1:SELECT=5 {{(pid=120835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:40:03.135877 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-577a75c8-a217-429b-932f-e3b28973a90e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:40:03.136549 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-577a75c8-a217-429b-932f-e3b28973a90e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:40:03.144756 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-577a75c8-a217-429b-932f-e3b28973a90e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:40:03.145318 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-577a75c8-a217-429b-932f-e3b28973a90e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:40:03.145841 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-577a75c8-a217-429b-932f-e3b28973a90e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:40:03.146666 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-577a75c8-a217-429b-932f-e3b28973a90e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:40:03.147185 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-577a75c8-a217-429b-932f-e3b28973a90e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:40:03.147685 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-577a75c8-a217-429b-932f-e3b28973a90e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:40:03.178581 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-577a75c8-a217-429b-932f-e3b28973a90e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Going to try to terminate instance {{(pid=120834) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 07:40:03.222017 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-9fa01920-a244-4ca6-8456-11aa3f0e49a8 req-3d0dee91-2377-4317-a4dc-3383abf605b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e628869-f998-4c45-a905-3dd276ca94f5", "tag": "9baee402-152f-4aa2-a956-c2704e4b760c"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:40:03.231547 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-9fa01920-a244-4ca6-8456-11aa3f0e49a8 req-3d0dee91-2377-4317-a4dc-3383abf605b3 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:40:03.232078 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-9fa01920-a244-4ca6-8456-11aa3f0e49a8 req-3d0dee91-2377-4317-a4dc-3383abf605b3 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:40:03.232446 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-9fa01920-a244-4ca6-8456-11aa3f0e49a8 req-3d0dee91-2377-4317-a4dc-3383abf605b3 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:40:03.244305 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-9fa01920-a244-4ca6-8456-11aa3f0e49a8 req-3d0dee91-2377-4317-a4dc-3383abf605b3 service nova] Creating event network-changed:9baee402-152f-4aa2-a956-c2704e4b760c for instance 4e628869-f998-4c45-a905-3dd276ca94f5 on hv-cinder-85312 Aug 17 07:40:03.250848 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-9fa01920-a244-4ca6-8456-11aa3f0e49a8 req-3d0dee91-2377-4317-a4dc-3383abf605b3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120592 Aug 17 07:40:03.251451 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 530/1058] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 07:40:03.270691 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-577a75c8-a217-429b-932f-e3b28973a90e tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 204 len: 0 microversion: 2.1 time: 0.142788 Aug 17 07:40:03.271611 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 529/1059] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 17 07:40:03 2022] DELETE /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 07:40:03.280810 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-bdcb30fb-c2d6-418b-b3ca-54d040601695 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:40:03.281519 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-bdcb30fb-c2d6-418b-b3ca-54d040601695 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:40:03.287779 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bdcb30fb-c2d6-418b-b3ca-54d040601695 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:40:03.288255 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bdcb30fb-c2d6-418b-b3ca-54d040601695 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:40:03.288684 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bdcb30fb-c2d6-418b-b3ca-54d040601695 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:40:03.289379 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bdcb30fb-c2d6-418b-b3ca-54d040601695 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:40:03.289826 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bdcb30fb-c2d6-418b-b3ca-54d040601695 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:40:03.290276 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-bdcb30fb-c2d6-418b-b3ca-54d040601695 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:40:03.427153 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.policy [None req-bdcb30fb-c2d6-418b-b3ca-54d040601695 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:40:03.434785 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-bdcb30fb-c2d6-418b-b3ca-54d040601695 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1569 microversion: 2.1 time: 0.158591 Aug 17 07:40:03.435362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 531/1060] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:40:03 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:40:04.457075 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-c1d7e1b4-7cc4-4211-8333-5d5ecff952bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:40:04.457778 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-c1d7e1b4-7cc4-4211-8333-5d5ecff952bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:40:04.464245 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c1d7e1b4-7cc4-4211-8333-5d5ecff952bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:40:04.464723 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c1d7e1b4-7cc4-4211-8333-5d5ecff952bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:40:04.465160 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c1d7e1b4-7cc4-4211-8333-5d5ecff952bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:40:04.465851 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c1d7e1b4-7cc4-4211-8333-5d5ecff952bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:40:04.466335 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c1d7e1b4-7cc4-4211-8333-5d5ecff952bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:40:04.466762 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-c1d7e1b4-7cc4-4211-8333-5d5ecff952bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:40:04.837103 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-c1d7e1b4-7cc4-4211-8333-5d5ecff952bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:40:04.844792 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-c1d7e1b4-7cc4-4211-8333-5d5ecff952bc tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1569 microversion: 2.1 time: 0.391930 Aug 17 07:40:04.845359 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 530/1061] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:40:04 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1569 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:40:05.640767 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [req-1cedad65-949d-4bff-926d-8d710c2b4cdf req-4928a722-f401-4b5a-8eea-51bf53f3e798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e628869-f998-4c45-a905-3dd276ca94f5", "name": "network-vif-deleted", "tag": "9baee402-152f-4aa2-a956-c2704e4b760c"}]} {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 07:40:05.650482 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-1cedad65-949d-4bff-926d-8d710c2b4cdf req-4928a722-f401-4b5a-8eea-51bf53f3e798 service nova] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:40:05.650951 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-1cedad65-949d-4bff-926d-8d710c2b4cdf req-4928a722-f401-4b5a-8eea-51bf53f3e798 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:40:05.651380 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [req-1cedad65-949d-4bff-926d-8d710c2b4cdf req-4928a722-f401-4b5a-8eea-51bf53f3e798 service nova] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:40:05.661857 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.compute.server_external_events [req-1cedad65-949d-4bff-926d-8d710c2b4cdf req-4928a722-f401-4b5a-8eea-51bf53f3e798 service nova] Creating event network-vif-deleted:9baee402-152f-4aa2-a956-c2704e4b760c for instance 4e628869-f998-4c45-a905-3dd276ca94f5 on hv-cinder-85312 Aug 17 07:40:05.666779 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [req-1cedad65-949d-4bff-926d-8d710c2b4cdf req-4928a722-f401-4b5a-8eea-51bf53f3e798 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092625 Aug 17 07:40:05.667719 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 532/1062] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 17 07:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 07:40:05.865426 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-3a04bea0-1f73-47b9-b6bf-8ccfda96c668 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:40:05.866649 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.compute.api [None req-3a04bea0-1f73-47b9-b6bf-8ccfda96c668 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120834) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:40:05.873488 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3a04bea0-1f73-47b9-b6bf-8ccfda96c668 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:40:05.873988 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3a04bea0-1f73-47b9-b6bf-8ccfda96c668 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:40:05.874418 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3a04bea0-1f73-47b9-b6bf-8ccfda96c668 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:40:05.875112 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3a04bea0-1f73-47b9-b6bf-8ccfda96c668 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:40:05.875560 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3a04bea0-1f73-47b9-b6bf-8ccfda96c668 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:40:05.876828 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG oslo_concurrency.lockutils [None req-3a04bea0-1f73-47b9-b6bf-8ccfda96c668 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:40:05.953125 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.policy [None req-3a04bea0-1f73-47b9-b6bf-8ccfda96c668 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61223d3bd5d84a88bed479f055186dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120834) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 07:40:05.962980 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-3a04bea0-1f73-47b9-b6bf-8ccfda96c668 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 200 len: 1220 microversion: 2.1 time: 0.101153 Aug 17 07:40:05.963870 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 531/1063] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:40:05 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 07:40:06.984680 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e8ff6139-c231-4ac3-a11f-31c2888dcf2f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '>' {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:40:06.985631 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.compute.api [None req-e8ff6139-c231-4ac3-a11f-31c2888dcf2f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] [instance: 4e628869-f998-4c45-a905-3dd276ca94f5] Fetching instance by UUID {{(pid=120835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 07:40:06.992238 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e8ff6139-c231-4ac3-a11f-31c2888dcf2f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:40:06.992713 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e8ff6139-c231-4ac3-a11f-31c2888dcf2f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:40:06.993144 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e8ff6139-c231-4ac3-a11f-31c2888dcf2f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:40:06.993825 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e8ff6139-c231-4ac3-a11f-31c2888dcf2f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Acquiring lock "e30419f5-f844-4338-aa4e-6c29191d9231" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 07:40:06.994306 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e8ff6139-c231-4ac3-a11f-31c2888dcf2f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 07:40:06.994732 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG oslo_concurrency.lockutils [None req-e8ff6139-c231-4ac3-a11f-31c2888dcf2f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Lock "e30419f5-f844-4338-aa4e-6c29191d9231" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 07:40:07.008392 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.wsgi [None req-e8ff6139-c231-4ac3-a11f-31c2888dcf2f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] HTTP exception thrown: Instance 4e628869-f998-4c45-a905-3dd276ca94f5 could not be found. Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e8ff6139-c231-4ac3-a11f-31c2888dcf2f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Request method failure captured: Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: request: GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 HTTP/1.1 Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept: application/json Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Accept-Encoding: identity Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Connection: close Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Length: 0 Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Content-Type: application/json Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Host: 10.222.0.45 Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Openstack-System-Scope: None Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: User-Agent: python-urllib3/1.26.11 Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Auth-Token: gAAAAABi_Jos6yf2GtJBgcFpSf11QbnVLgsOBoSG9Be74SDWsx_OdODUK1rq27fnyj173jmSc3ZuQvTt6FU06nBmZPeYg2On4z9-_LOStMgz5R9ox15gLhPLdMzzA3eooHuz4-dOG179pTQXJbpIj-kcm79zidvwl2TPmuo8nfrOhKzoyiRDTOc Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Id: None Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Domain-Name: None Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Identity-Status: Confirmed Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Is-Admin-Project: True Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Id: default Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Domain-Name: Default Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Id: 7eaf872dd2f4428ca13c52c4a06f7bdd Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Project-Name: tempest-TestShelveInstance-114475361 Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Role: member,reader Aug 17 07:40:07.010005 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Roles: member,reader Aug 17 07:40:07.011742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7eaf872dd2f4428ca13c52c4a06f7bdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7eaf872dd2f4428ca13c52c4a06f7bdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7eaf872dd2f4428ca13c52c4a06f7bdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7eaf872dd2f4428ca13c52c4a06f7bdd"}]}] Aug 17 07:40:07.011742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant: tempest-TestShelveInstance-114475361 Aug 17 07:40:07.011742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Id: 7eaf872dd2f4428ca13c52c4a06f7bdd Aug 17 07:40:07.011742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-Tenant-Name: tempest-TestShelveInstance-114475361 Aug 17 07:40:07.011742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User: tempest-TestShelveInstance-114475361-project Aug 17 07:40:07.011742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Id: default Aug 17 07:40:07.011742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Domain-Name: Default Aug 17 07:40:07.011742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Id: 61223d3bd5d84a88bed479f055186dbf Aug 17 07:40:07.011742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: X-User-Name: tempest-TestShelveInstance-114475361-project Aug 17 07:40:07.011742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: method: > Aug 17 07:40:07.011742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: exception: Instance 4e628869-f998-4c45-a905-3dd276ca94f5 could not be found. Aug 17 07:40:07.011742 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: action_args: {'id': '4e628869-f998-4c45-a905-3dd276ca94f5'} Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: {{(pid=120835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e628869-f998-4c45-a905-3dd276ca94f5 could not be found. Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 07:40:07.012673 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 07:40:07.014362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 07:40:07.014362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 07:40:07.014362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 07:40:07.014362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 07:40:07.014362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 07:40:07.014362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 07:40:07.014362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 07:40:07.014362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e628869-f998-4c45-a905-3dd276ca94f5 could not be found. Aug 17 07:40:07.014362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:40:07.014362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 07:40:07.014362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:40:07.014362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 07:40:07.014362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 07:40:07.014362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 07:40:07.014362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 07:40:07.014362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 07:40:07.014362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e628869-f998-4c45-a905-3dd276ca94f5 could not be found. Aug 17 07:40:07.014362 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: ERROR nova.api.openstack.wsgi Aug 17 07:40:07.015858 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: DEBUG nova.api.openstack.wsgi [None req-e8ff6139-c231-4ac3-a11f-31c2888dcf2f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Returning 404 to user: Instance 4e628869-f998-4c45-a905-3dd276ca94f5 could not be found. {{(pid=120835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 07:40:07.015858 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO nova.api.openstack.requestlog [None req-e8ff6139-c231-4ac3-a11f-31c2888dcf2f tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5" status: 404 len: 111 microversion: 2.1 time: 0.031292 Aug 17 07:40:07.015858 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: [pid: 120835|app: 0|req: 533/1064] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 17 07:40:06 2022] GET /compute/v2.1/servers/4e628869-f998-4c45-a905-3dd276ca94f5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 07:40:07.166284 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: DEBUG nova.api.openstack.wsgi [None req-2b72d9b9-f088-4e47-b71c-98354c7d6c70 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] Calling method '.version_select at 0x7f30ac36c430>' {{(pid=120834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 07:40:07.185313 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO nova.api.openstack.requestlog [None req-2b72d9b9-f088-4e47-b71c-98354c7d6c70 tempest-TestShelveInstance-114475361 tempest-TestShelveInstance-114475361-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1335859032" status: 202 len: 0 microversion: 2.1 time: 0.023400 Aug 17 07:40:07.185927 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: [pid: 120834|app: 0|req: 532/1065] 10.222.0.45 () {58 vars in 1254 bytes} [Wed Aug 17 07:40:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1335859032 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 07:42:08.084009 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 07:42:08.084786 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Wed Aug 17 07:42:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 07:42:24.672950 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 07:42:24.673598 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Wed Aug 17 07:42:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 07:42:25.037638 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 07:42:25.038368 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Wed Aug 17 07:42:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 07:43:14.581797 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 07:43:14.582503 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Wed Aug 17 07:43:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 07:43:45.172016 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 07:43:45.172735 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Wed Aug 17 07:43:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 07:45:15.853162 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 07:45:15.853841 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Wed Aug 17 07:45:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 07:45:28.092090 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 07:45:28.092815 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Wed Aug 17 07:45:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 07:45:44.681627 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 07:45:44.682355 dv-cinder-853126-2-iscsi devstack@n-api.service[120834]: Wed Aug 17 07:45:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 07:45:45.045596 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 07:45:45.046102 dv-cinder-853126-2-iscsi devstack@n-api.service[120835]: Wed Aug 17 07:45:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!